Local LLM

Running and optimizing local large language models, quantization, and inference setups.