AIQB
TutorialsOrdinary

Whisper on the RK3588 NPU: the encoder offload works — everything around it is the real lesson

Source: DEV Community·

Summary

Status: encoder offload merged into a working whisper.cpp path on an RK3588 board, transcription...
CategoryAI Tutorials & Practice
TierOrdinary
Published
Indexed by AIQB
SourceDEV Community
AIQB record IDintel-159cbf38540e0935feb5b04b
Read original source ↗More Tutorials

Related stories

Matched by category, entity tags and source

TutorialsOrdinary
I gave my social media scheduler an MCP server. Here's what I learned building it.
Social media scheduling is the kind of task AI agents should be perfect at. It's structured (a...
Source: DEV Community
TutorialsOrdinary
Same model, same chip, 27 apart: the runtime path is the performance
YOLOv11-N on a Qualcomm Dragonwing RB3 Gen 2 (QCS6490), measured on Qualcomm AI Hub's real-device...
Source: DEV Community
TutorialsOrdinary
Your AI agent's token bill is mostly input. Here is the field guide to cutting it.
Your AI agent's token bill is mostly input. Here is the field guide to cutting...
Source: DEV Community
TutorialsOrdinary
Training MoE Models Is Complicated. Hugging Face Just Wrote the Manual.
I've spent a fair amount of time recently experimenting with Mixture of Experts (MoE) models on my...
Source: DEV Community · Hugging Face
TutorialsOrdinary
PrivaSearch: private AI search with SearXNG and a local LLM
I wanted AI-synthesized search answers without sending my queries to anyone. PrivaSearch is the...
Source: DEV Community
TutorialsOrdinary
Making browser perception cheap for LLM agents: snapshots, caching and diffs
Most "give the model a browser" setups hand it one of two things: a screenshot, or a dump of the full...
Source: DEV Community
TutorialsOrdinary
We are all excited about bringing new agents online. I am thinking about retiring one, how do you go about it?
Nobody Writes About Retiring an Agent. Here's the Checklist. ...
Source: DEV Community
TutorialsOrdinary
Nobody Writes About Retiring an Agent. Here's the Checklist.
Nobody Writes About Retiring an Agent. Here's the Checklist. We have onboarding docs for...
Source: DEV Community
TutorialsOrdinary
Frontier LLM prices sat flat all October. Then two cheaper flagships took seats, and one doubles on December 1
The LLM Price Index didn't move once in October. Same ten flagships, same ten list prices, from...
Source: DEV Community
TutorialsOrdinary
Production Problems in RAG and How to Solve Them
Indexing a document is easy. Keeping millions of vectors in sync with documents that keep changing is the real job. Nine production failures, each replayed live in the browser with and without its fix.
Source: DEV Community