Metrics Proof of Concept
Have a proof of concept of an asyncronic version of LM-evaluation-harness working on the Pocket Network
2024-05 : Test-Bench Proof of Concept - LocalNet
For the month of May we expect to: Finish the Manager code: Most work to be done is buffer handling. We do not expect to implement elaborated sampling strategies at this pint. Finish the Sampler code: Task is advanced we need to finish and test the correct writing of the MongoDB…
Finish MLTB - Present Results
Future Work TL-DR Manager: Create logic for tokenizer signature task Clean completed tasks Add signatures to node Sampler: Create logic for tokenizer signature task Add asynchronous read operations to the MongoDB collections. Evaluator: Create initial code for LMEH processing Cre…
2024/03 Update
Wrote first repport covering general ML concepts and the capability of Pocket Network Morse. Released a Local-Net proof of concept for the Pocket Network (Morse). The Local-Net features two ML services: LLM and Diffusion Models (text to image generation). Updated pocket-core and…
POKT AI Lab
Create a research and development team focused on the Quality of Service (QoS) of Machine Learning (ML) models deployed in the POKT Network. As first deliverables we aim to create an open evaluation framework, a leaderboard of staked ML models and tools for model staking. The lon…