|
|
|
|
| 🎤You're in a prompt battle against another LLM, what trash talk you got?
|
|
|
|
|
|
Voting isn't open yet, but even Big JC's getting excited about our March Model Madness knockout comp.When voting does open on 25 March, it will be a blind voteβthe models are only revealed once they're defeated. While you wait to get voting, submit your prompts for a chance to win prizes and be part of the biggest showdown since Magic Johnson Vs. Larry Bird. Or, for those not into basketball, Hulk Hogan Vs. Andre the Giant in WrestleMania III.
|
|
|
MLOps Community Roundtable
|
|
|
|
|
Why Purpose-built Vector Databases Matter for Your Use Case // Frank Liu // Jiang Chen // Yujian Tang With the recent talk about the next James Bond, I thought I'd throw my straw hat into the ring, so I need a suit. Off-the-rack just won't cut it; sometimes, you need something bespoke, purpose-made.
This nicely leads to this chat on the importance of purpose-built vector databases! We covered the limitations of long context models and how vector databases can improve real-world search, use cases, potential issues, and best practices. They also shared some development insights, upcoming features for Milvus, and the challenges of generating embeddings and managing vector databases.
The name'sh Demetriosh, from the MLOpsh Community. Thanksh for lishening. 🍸 (That was Sean Connery, not too many Martinis!)
|
|
|
MLOps AI in Production Conference Rewind
|
|
|
|
|
Security and Privacy Panel // Diego Oppenheimer // Ads Dawson // Katharine Jarmul // David Haber I've got the suit sorted, but to be in the Secret Service, I'm going to need to know all about Security.
Well, this Panel from our AI in Production Conference covered that. Thinking about the shift from traditional ML to LLMs, they discussed the underlying challenges, such as privacy engineering, traditional vulnerabilities, the need for new evaluation criteria, and the lack of user knowledge about AI risks.
They emphasized the importance of frameworks like the OAS Project for managing AI risks and debated AI memory vs human learning and real-world implications
like content licensing and legalities.
Sorted. Now I just need to get the gadget filled car.
|
|
|
💡Job of the weekSenior Machine Learning Software Engineer // Grok (US, remote)
As a part of the ML Systems team, you will work closely with the sales, applications, and engineering teams to develop and optimize ML models and systems for Groq's hardware and contribute to original research.
Responsibilities: - Develop and optimize ML models and kernels for Groq hardware across various domains using proprietary and popular frameworks.
- Analyze and compare the performance of models on Groq and competitor hardware to identify optimization opportunities.
- Influence Groq hardware features based on optimization insights from performance analyses.
- Publish research on model optimizations and hardware improvements in leading ML conferences.
Requirements: - Foundational knowledge in neural networks and mathematics, with proficiency in at least one area among computer vision, natural language processing, recommendation engines, reinforcement learning, and linear algebra.
- Experienced with programming languages (Python, C/C++), machine learning frameworks (TensorFlow, PyTorch, Caffe), and hardware accelerator languages (CUDA, MKLDNN), including programming on FPGAs or DSPs from evaluation to production.
- Understand processor architectures and distributed systems, recognizing their impact on machine learning model performance.
|
|
|
MLOps Community IRL Meetup
|
|
|
|
|
How Autonomous Agents Can Help You Get LLMs Ready for
Production // Chris Booth // IRL #69 Bristol
From Secret Agents to Autonomous Agents!
Specifically, it discusses their use for tasks in natural language processing and chatbots, with a case study on Evo. It tackles the deployment challenges of autonomous agents, like explainability and latency, and outlines strategies for enhancing language model reliability, such as thought chaining and fine-tuning. It also looks at the future of language models and encourages collaboration by sharing resources and repositories.
A good talk to make sure you donβt end up with a rogue agent.
|
|
|
|
|
|
|
Basics of Instruction Tuning with OLMo 1B I'm squeezing every last drop out of the Secret Agent links I can. To be in the Secret Service, you've got to be fine-tuned. (Can you see where this is going?)
This blog looks at a before-and-after comparison, showing how fine-tuning, specifically instruction-tuning, can improve a modelβs response to instructions. It uses AI2βs OLMo-1B model as an example to provide a clear and easy starting point. It covers loading and testing the model, formatting the
fine-tuning dataset, and using the Hugging Face Transformers Trainer. There's just one clear instruction to follow now: read the blog!
With thanks to Daniel Liden from Databricks for their contribution.
|
|
|
|
|
Make your MLOps code base SOLID with Pydantic and Pythonβs ABC Crowbarring one last reference in... GI Joe had the Rise of Cobra, we've got Python's ABC.
This article specifically examines using Pydantic and Python's ABC to create well-structured and robust MLOps projects. Pydantic enforces data validation and type annotations, while Python's ABC helps implement SOLID principles. This combination allows for focusing on core functionalities and avoiding repetitive tasks like building custom validators and object factories. The article also compares the proposed solution with classical object-oriented and functional-oriented approaches.
Insights more useful than a room full of gadgets from Q.
With thanks to MΓ©dΓ©ric Hurier for their contribution.
🐍SNAKES ALIVE! A BONUS BLOG BIT!🐍
You might remember this blog MΓ©dΓ©ric wrote last year about creating a robust and productive Python code base for MLOps projects. Well, not one to stand still, he's now released v1.0.0 of an OSS project, which adds major improvements to the code structure, features, and tools.
When does he have time to sleep?
|
|
|
|
|
Add your profile to our jobs board here
|
|
|
|
|
Madrid - March 21 Bristol - March 26 (cheers to Berkeley Square 🙌) Stockholm - April 23 (shout out to Weights & Biases, Stormgrid,Β ...................................Crowd Collective, and AI Sweden)
|
|
|
|
|
|
|
|
|