R&D · lab notebook

Research & notes

Where I write up my own studies and take apart other people's papers. Every claim gets a number, and every number comes with its limitations.

Heading into an M.Sc. in Computer Science · 2027

papers
2papers
note
1note
focus areas
5focus areas
R&DLLM evaluationRAGRetrievalFine-tuningHebrew NLPLLM judgesAgents

01

What I'm curious about

02

Papers

Studies I designed, ran and wrote up, each with its code, data and an honest limitations section.

Technical report · Sep 2026RAGInformation retrievalLLM evaluation

Is Hybrid Retrieval Worth It? An Evaluation-Driven Comparison of Dense, Sparse and Hybrid RAG on Multi-Hop News Questions

Hybrid search is recommended for RAG by default. Does it actually help, and by how much?

context recall, hybrid (vs 0.525 dense)
0.625context recall, hybrid (vs 0.525 dense)
trap questions refused
9 / 10trap questions refused
of needed evidence in top 5
17–26%of needed evidence in top 5
retrieval latency, no LLM
38–83 msretrieval latency, no LLM

Read the paper page →PDF ↗Live explorer ↗Code ↗

Paper · Sep 2026Fine-tuningHebrew NLPRAG

Teaching a Small Hebrew Model to Explain Bureaucracy: Fine-Tuning DictaLM 1.7B with Teacher-Generated Data

Can a small, open Hebrew model that runs on a laptop learn to answer in plain Hebrew, cite sources and say “I don't know”?

correct refusals
0% → 61%correct refusals
letter-format compliance
28% → 100%letter-format compliance
correct answers (manual)
8 → 16 / 30correct answers (manual)
per answer on a laptop CPU
51 → 33 sper answer on a laptop CPU

Read the paper page →PDF ↗Model on Hugging Face ↗Code ↗

03

Notes

My blog: close readings of papers, lessons from my own experiments, and the road to my M.Sc.

  1. My experiments· 2 min readWhen hybrid search loses: a lesson from Reciprocal Rank FusionIn my hybrid RAG benchmark, a chunk ranked #1 by dense search lost to a mediocre one. Here's why RRF rewards agreement over confidence.#RAG#Retrieval#Evaluation