Ir al contenido

ML Engineer · Computer Vision & LLMs

Juan Manuel Ruiz Muñoz

I take vision and language models from research to production: industrial defect detection and segmentation, LoRA-tuned multimodal OCR and RAG systems. Trained as a physicist and mathematician, I care about understanding why a model works before shipping it.

  • 0.83 mAP@50:95 on multi-class segmentation, in production
  • 98.56% exact match of a multimodal OCR (GLM-OCR + LoRA) in production
  • DCAI'25 paper on misinformation detection with LLMs and RAG
  • 35.9% activation recovery with a ~2 KB calibration filter (vcalib)

Elche, Alicante, Spain

Juan Manuel Ruiz Muñoz

About me

Physicist and mathematician specialized in Machine Learning and Computer Vision engineering. I take vision and language models to real production: from data to deployment with Docker, vLLM and MLflow. I care about understanding models deeply, not just training them. When I am not training models, I write about physics, chaos and meteorology on this blog.

...

Experience

1

Publications

5

Open source

Download CV

Projects

In production

Industrial tire inspection with vision models and multimodal OCR

Defect detection and segmentation (CNNs, ViT, YOLO, RF-DETR) plus sidewall reading with a LoRA-tuned GLM-OCR, in production at VRAIA. Served with vLLM and Docker.

  • mAP@50:95 of 0.83 on multi-class segmentation
  • 98.56% exact match on sidewall OCR
PyTorchRF-DETRGLM-OCRLoRAvLLMDocker

Experience

ML Engineer · Computer Vision & LLMs

VRAIA Corp.

June 2025 - Present

I take defect detection and segmentation models (CNNs, ViT, YOLO, RF-DETR) and a multimodal OCR (GLM-OCR) to production for industrial tire inspection: mAP@50:95 of 0.83 and 98.56% exact match reading sidewalls.

I write about this work in OCR in extreme conditions and CNNs vs Vision Transformers.

  • Design and training of defect detection and segmentation models (CNNs, Vision Transformers, YOLO, RF-DETR) for industrial tire inspection: mAP@50:95 of 0.83 on multi-class segmentation over in-house datasets of thousands of images.
  • Fine-tuning of a multimodal language model (GLM-OCR) with LoRA via LLaMA-Factory to read text on tire sidewalls: 98.56% exact match in production; served with vLLM and Ollama.
  • Synthetic defect generation pipeline with generative models to enlarge scarce datasets and improve detection robustness.
  • Technical appraisal with CNNs and Vision Transformers to compare products objectively and reproducibly from their structural and appearance parts.
  • ETL pipelines for extracting, transforming and augmenting visual datasets at industrial scale.
  • Deployment and monitoring with Docker, MLflow and TensorBoard; evaluation metrics (precision, recall, F1, mAP, IoU) for real-time validation; technical documentation and algorithm specification in C++ for the client team.
PyTorch Vision Transformers YOLO RF-DETR GLM-OCR LoRA LLaMA-Factory vLLM MLflow Docker C++

Data Scientist & AI Researcher

AIR Institute & BISITE Research Group

June 2024 - June 2025

Research in NLP and LLMs: an ontology-based misinformation-detection architecture built with LLM-generated ontologies (published at DCAI'25), RAG pipelines and multi-agent systems, plus computer vision projects.

Publication: DCAI'25 paper.

  • Research and development of NLP and LLM solutions, including a misinformation-detection architecture based on ontologies generated with language models (published at DCAI'25).
  • RAG and semantic-retrieval pipelines with vector databases (ChromaDB) and multi-agent systems (Ollama, DeepSeek, GPT-4o-mini), focused on cutting cost and latency.
  • Computer vision projects (detection, classification and segmentation) and end-to-end ML project management: requirements, development, validation and documentation.
  • Direct interaction with clients to capture requirements and adapt state-of-the-art solutions to real use cases.
NLP LLMs RAG ChromaDB Multi-agent Ollama Computer Vision Python
January 2024 - July 2024

I developed Lagrangian methods to automatically identify atmospheric blocking situations — the basis of my thesis and a publication in progress.

I tell the full story in Atmospheric blocking, a Lagrangian view.

  • Development of Lagrangian methods for the automatic identification of atmospheric blocking situations, the basis of my thesis and of a publication in progress.
  • Collaboration on projects of the atmospheric physics group.
Python Atmospheric Physics HYSPLIT ERA5 DBSCAN

Education

Bachelor's Degree in Physics

Universidad de Alicante

+120 ECTS from the Mathematics degree taken in parallel (UA simultaneous-studies program).

2020 - 2024

Thesis: A Lagrangian method for the identification of atmospheric blocking situations

SICUE Exchange — Physics & Mathematics

Universidad de Salamanca

International mobility scholarship.

2022 - 2023

Certifications

AWS Cloud Technical Essentials

Amazon Web Services

Build Basic Generative Adversarial Networks (GANs)

DeepLearning.AI

Introduction to Front-End Development

Meta

Cambridge English B1 Preliminary

Cambridge Assessment English

Publications

DCAI'25 DCAI 2025 · International Conference on Distributed Computing and Artificial Intelligence

AI-Powered Ontology-Based Architecture for Misinformation Detection in Fiction Works

Marcos Arias-González, Juan Manuel Ruiz Muñoz, Pablo Armenteros Cosme, Lucía Isabel Rodríguez González, Javier Curto Hernández

BISITE Research Group, University of Salamanca · TRUESTORIES project (CPP2021-008358)

In progress Publication in progress based on the bachelor's thesis (University of Alicante · SCOLAb group, UMH)

A Lagrangian Method for the Identification of Atmospheric Blocking Situations

Skills

LLMs & NLP

Fine-tuning (LoRA) LLaMA-Factory RAG Transformers vLLM Ollama Embeddings & semantic search ChromaDB FAISS Prompt engineering

Computer Vision

PyTorch TensorFlow Keras OpenCV CNNs Vision Transformers YOLO RF-DETR Diffusion models (FLUX.1) Detection & segmentation

Languages & analysis

Python NumPy Pandas scikit-learn Matplotlib C++ (reading & specs) R Statistical analysis LaTeX

MLOps & tools

Docker MLflow TensorBoard Git & GitHub AWS (Cloud Technical Essentials) Linux / SSH uv Jupyter

Contact

Got a computer vision or LLM problem to take to production? Drop me a line.

Juan Manuel Ruiz Muñoz

Juan Manuel

ML Engineer · Computer Vision & LLMs