Evaluation - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

ryan2run

Sep 14

AI Model Evaluation: Best Practices for Testing and Validation

#ai #evaluation #machinelearning #testing

2 min read

Sep 12

Stop asking the model that wrote the code to review it

#aicodereview #evaluation #aiagents #codereview

2 min read

Cristian Gormaz

Sep 7

El modelo encontró evidencia relevante y aun así falló: por qué “alucinación” se me quedó corta

#ai #testing #llm #evaluation

4 min read

Sep 7

The sleep loop is the tell: agents that pay per action optimize to do nothing

#aiagents #evaluation #llm #benchmarking

2 min read

Sep 7

The model did the reverse-engineering. The validator was the hard part.

#aicoding #agents #llm #evaluation

2 min read

PRANJUL RATHOUR

Sep 6

Judging AI hackathon projects: what to check when every team says 'we used AI'

#hackathonjudging #ai #evaluation #rubric

3 min read

PRANJUL RATHOUR

Sep 6

How to evaluate a RAG system: recall, faithfulness and the questions that matter

#rag #evaluation #metrics #guide

3 min read

Sep 10

The benchmark that disproved its own result

#localmodels #llm #evaluation #buildinpublic

6 min read

Sep 4

How to Evaluate AI Agents

#ai #agentskills #agents #evaluation

7 min read

Ama Senevirathne

Sep 5

JuryTrace: make agent-judge failures inspectable

#ai #llm #evaluation #python

4 min read

Erik Hill

Aug 31

My board never scored an outage as a regression. My evidence couldn't prove it.

#evaluation #testing #llm #opensource

5 min read

Aug 30

We spent two days bisecting a prompt change. The regression was noise.

#mlops #regression #evaluation #agents

1 min read

Sep 12

They knew it wasn't the model. They patched it anyway.

#ai #agents #evaluation #research

9 min read

Sep 11

Nineteen of twenty patched the symptom

#ai #agents #evaluation #research

9 min read

Aug 25

Production-Ready Multi-Turn Evaluation

#multiturn #evaluation #python #docker

7 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.