Features:
- GitHub Repo access to the content below
- Ability to post Issues
Repo Content = all you need to evaluate LLM performance:
- Creating evaluation datasets
- Manual dataset curation
- NEW: Import datasets from HuggingFace
- Setting up LLM as a judge
- Measuring the performance of your AI system (i.e. running “evals”)
- Creating high-quality examples for prompt engineering
- UI for dataset and pipeline creation and management, including running evals
Notes:
- Price for new buyers increases periodically as new content is added.
Purchase Options
Evals Repo Access (join 158+ members)
LIFETIME access, plus support via Github Issues, for one individual:
For TEAM access (i.e. repo used by multiple engineers), kindly post a comment below. It will be submitted privately and I’ll respond by email.
Trelis Multi-Repo Bundle
LIFETIME access to all SEVEN Trelis Repos (Voice, Vision, Fine-tuning (LLMs), Inference, Evals and Time-Series, Robotics) + support via Github Issues PLUS Trelis Discord Access for one individual.
Want lifetime access for a team? Purchase lifetime access here.
Testimonials from Youtube Comments
“Awesome content. Thank you! Purchased your gated repo and learning loads from it.”
“Thank you! It’s a great investment :)”
“I had Whisper&CoLab running a few months ago, but it broke. Your video and notebooks showed me why, and taught me several new tricks! Keep it up please.”
Repo Screenshots
Frequently Asked Questions
Q: Can I get a formal invoice with my tax number so I can reimburse this expense?
Yes, purchases come with an invoice and receipt of payment. You can include your tax/VAT number (not applicable for personal purchases or those using the LEARN discount). If you require modifications to the invoice, just respond to your email receipt.
Q: Is support included in my repo purchase?
Yes, if you purchase repo access, you will be able to post Issues in the corresponding Github repo.
Q: Can I buy individual scripts for one video?
Yes, if you only wish to purchase scripts for one video, you can post a comment and I will add a purchase link. Purchases of individual scripts do not provide GitHub repo access or the ability to post issues to get support.
Q: Is there a student discount available?
Yes. Use LEARN2025 at checkout if EITHER of the following applies:
a) You are currently a registered student at an academic institution.
b) You will use these materials only for non-commercial purposes.
After your purchase, reply to your receipt with a quick note indicating whether a or b applies. In the case of a, kindly provide a link to your LinkedIn page. Purchases using a company email/tax number/Github are not eligible for this discount. This discount applies to repos or the repo bundle, but not to individual scripts.