AIQB
TutorialsOrdinary

LoRA on a 16 GB card: what fits and what does not

Source: DEV Community·

Summary

A 7B model is the honest ceiling for LoRA fine-tuning on a 16 GB consumer card, not because anything...
CategoryAI Tutorials & Practice
TierOrdinary
Published
Indexed by AIQB
SourceDEV Community
AIQB record IDintel-734f1dd3bbb59612252eba60
Read original source ↗More Tutorials

Related stories

Matched by category, entity tags and source

TutorialsOrdinary
Best AI Collaboration Tools for High-Performing Teams in 2026
AI collaboration tools are changing how teams plan projects, share information, and get work done....
Source: DEV Community
TutorialsOrdinary
Agentic Pentest Frameworks (2026): The Full Field Guide
A few days ago I published a short map of the LLM-driven pentest landscape. I promised a detailed...
Source: DEV Community
TutorialsOrdinary
Ofrenda Digital: A Candlelit Día de los Muertos Sanctuary Powered 100% Offline by Open-Weight Gemma AI
This is a submission for the Hacktoberfest Open-Source AI Challenge Week 4: Ghost in the...
Source: DEV Community
TutorialsOrdinary
How RAG Actually Works: Chunking, Embeddings, Retrieval, and Reranking Under the Hood
Deep dive into how RAG actually works under the hood — chunking strategies, hybrid BM25+dense retrieval with RRF, cross-encoder reranking, HyDE, parent-child retrieval, and production pipeline configuration.
Source: DEV Community
TutorialsOrdinary
Side Chat IDs Are Addresses
On October 27, 2026, at 8:29 p.m. ET, a program on my homelab server sent a message into a Muse side...
Source: DEV Community
TutorialsOrdinary
Zero LLM Calls From a Working Agent. My Capture Hook Was Lying.
From the agentdrill v0.1.0 release, part of agentic-suite: open-source, harness-agnostic security...
Source: DEV Community
TutorialsOrdinary
What an internal MCP server actually solves
An internal MCP server does not make a model smarter. It solves a governance problem: without one, an...
Source: DEV Community
TutorialsOrdinary
Ghost in the Code: Offline Séance with Programming Language Spirits
This is a submission for the Hacktoberfest Open-Source AI Challenge: Week 4 — Ghost in the Machine ...
Source: DEV Community
TutorialsOrdinary
Ofrenda Viva: A Living Memorial Altar & AI Remembrance Chamber | Ghost in the Machine
A cultural memorial altar keeping ancestral memories alive through open AI: Google Gemma 2, Prior Labs TabPFN-3.5, Tinker fine-tuning, and Arduino hardware.
Source: DEV Community
TutorialsOrdinary
Not the End, but a Shift: How AI Is Pushing Computer Science Toward Deeper Engineering
If you're studying computer science right now, or you just graduated, you've probably heard some...
Source: DEV Community