✨ Generative AI - CWhiting · Scour

I Joined 30+ Gen AI Courses on Udemy: Here Are My BEST 5 Recommendations 🤖AI Development

javarevisited.blogspot.com·6d·javarevisited.blogspot.com

jmaczan/tiny-vllm: Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM 🏗️LLM Infrastructure

github.com·2d·Hacker News

Serving vLLM for LLM Inference 🏗️LLM Infrastructure

beam.cloud·18h

Generative AI Market Size, Share 🤖GenAI

polarismarketresearch.com·2d

Local LLM Deployment: Ollama vs vLLM vs LM Studio Compared 🏠Local LLM Deployment

sitepoint.com·3d

Comprehensive observability for Amazon SageMaker AI LLM inference: From GPU utilization to LLM quality 🏗️LLM Infrastructure

aws.amazon.com·2d

RTP-LLM: High-Performance Alibaba LLM Inference Engine 🏗️LLM Infrastructure

Structured LLM Outputs 🤖LLM

dottxt-ai.github.io·6d·Hacker News

The same 16 GPUs, twice the users: Inference-aware routing for LLM clusters 🏗️LLM Infrastructure

RLHF's Hidden Vulnerability: Alignment Tampering 🕳LLM Vulnerabilities

startuphub.ai·3d

Understanding Qwen 2.5: Features, Benefits, and Practical Applications 🏗️LLM Infrastructure

beam.cloud·18h

ankitvirdi4/awesome-llm-cost: Tools, libraries, papers, and patterns for reducing the cost of running large language models in production. 💰API Pricing

github.com·5d·r/OpenAI

人肉装饰器字Hanzi

How LLMs Learn Roles, Follow Instructions, and Get Exploited 💬LLM Prompting

hiddenlayer.com·5d

repanareddysekhar/llm-obs: Lightweight Python SDK for LLM inference logging and observability 🏗️LLM Infrastructure

github.com·4d·r/LLM

llm-inference-at-scale/content/00_foundations/00.1_why_llm_inference_is_different/why_llm_inference_is_different.md at master · harshuljain13/llm-inference-at-scale 🏗️LLM Infrastructure

github.com·3d·Hacker News

Injecting Image Guidance into Text-Conditioned Diffusion Models at Inference 🖼️Image Generation

Jailbreak to Protect: Buffering and Reinforcing via Temporary Jailbreaking for Safe Fine-Tuning in Large Language Models 💻Local LLMs

LLM Zeroth-Order Fine-Tuning is an Inference Workload ⚡LLM Optimization

EvoMD-LLM: Learning the Language of Species Evolution in Reactive Molecular Dynamics 🤖LLM

Log in to enable infinite scrolling