🎉 Deepchecks’ New Major Release: Evaluation for LLM-Based Apps!  Click here to find out more 🚀
Deepchecks
TechCrunch
VentureBeat
siliconANGLE
Yahoo Finance
ProductHunt
StartHub.AI
Deepchecks For LLM Evaluation
Chat GPT
Falcon
LLaMA
Cohere
Claude
PaLM
Custom
Chat GPT
Falcon
LLaMA
Cohere
Claude
PaLM
Custom

How Does It Work?

Deepchecks Open Source

Install Deepchecks Open Source to Take Care of Both Testing and Monitoring of Your ML

In the past, Deepchecks Open Source was focused only on testing ML during the research phase. As of June 2023, Deepchecks expanded this to a combination of testing and monitoring, so that data scientists and ML engineers can take multiple steps in their evaluation journey while remaining in the open source realm.

Testing

Deepchecks Testing is all about
users iteratively running test
suites on their data and models,
from within a notebook or an IDE.
Install Open Source

CI/CD

Deepchecks CI is all about running
the test suites you know (and
love) as part of your CI/CD, using
tools like GitHub Actions or
Airflow.
Get Started

Monitoring

Deepchecks Monitoring is all
about tracking data and models in
production to make sure your ML
system is behaving as expected.
Install Open Source
Deepchecks - Testing
Deepchecks - CI/CD
Deepchecks - Monitoring
pip install -U deepchecks from deepchecks.tabular.suites import train_test_validation suite_result = train_test_validation().run(train_dataset, test_dataset)

Deepchecks Hub

Combining the Continuous Evaluation of Multiple Models, in a Managed and Secure Setting, from Research to Production

Deepchecks Hub expands the functionality of Deepchecks Open Source to include everything your team will need in a commercial setting. This consists of a variety of scalable deployment options, a unified experience of validating multiple models in parallel, security and access management features, and support.

Deepchecks Supported Data Types

Deepchecks supports: Tabular data, Computer Vision and NLP throughout your model and
data lifecycle from training to production

Vision

Vision

Tabular

Tabular

NLP

NLP
Talk to an Expert

Explainer Video

Explainer Video

Easy to Install

Using Deepchecks is simple: For example, setting up
Deepchecks Open Source for tabular data requires
only two lines of code.

Please refer to Deepchecks Open Source “Getting
Started” here or Deepchecks Hub Getting Started
here for more information.

pip install -U deepchecks from deepchecks.tabular.suites import train_test_validation

Run Test Suites for CI/CD

Deepchecks Open Source can be used for CI/CD by
integrating just a few lines of code to your CI/CD
scripts. This will help you to ensure that your re-trained
model will not cause issues when deployed to
production.
Book a Demo
on: push: ['main'] job: run_suites: train_dataset: 'load.py:get_train_dataset'
test_dataset: 'load.py:get_test_dataset'
model: 'load.py:get_model'
suites: ['custom_suites.py:my_model_evaluation_suite']

Open Source & Community

Deepchecks is committed to keeping the ML evaluation package open-source and community-focused.

Subscribe to Our Newsletter

Do you want to stay informed? Keep up-to-date with industry news, the latest trends in MLOps, and observability of ML systems.