NEW PATH Generative AI & Agents — 10 readable lessons + research agent project

Hey, that’s me! Rahish · AI/ML Engineer I build & teach production AI

Rahish Hi, I’m Rahish · AI/ML Engineer ★ 4.9

Ship LLMs, RAG & Agents That Survive Production.

Move past fragile prompt demos. Learn how language models, hybrid retrieval, tool-calling agents, and evaluation harnesses actually work — through structured readable courses, runnable Python code, and daily frontier AI analysis.

  • 4 structured readable tracks
  • 34+ hands-on lessons
  • 140+ daily AI engineering briefings
Stack covered Python OpenAI / Claude / Gemini Hybrid RAG Tool-Calling Agents Evals & Guardrails

02 / The Production Gap

Every AI demo works on five tweets. Production breaks at 2:00 AM.

✗ TUTORIAL DEMO STACK Breaks under real traffic

“Just wrap an LLM call and stuff top-5 chunks into the prompt.”

  • 01Blindly splits PDFs every 500 characters — slicing tables and policy clauses in half.
  • 02No similarity score floor — when retrieval misses, the model confidently invents a policy.
  • 03Unbounded agent loops — one flaky tool call triggers 12 retries and burns $40 in tokens.
  • 04Evaluated by “vibes” on 3 manual prompts instead of a repeatable golden dataset.
✓ PRODUCTION AI ENGINEERING What we build here

Deterministic guardrails around probabilistic models.

  • 01Structure-aware chunking + hybrid BM25 & dense retrieval with cross-encoder reranking.
  • 02Explicit score thresholds and abstention paths ("I don't have enough context") with inline citations.
  • 03Strict tool schemas, step budgets, idempotency keys, and human-in-the-loop checkpoints.
  • 04Automated faithfulness, recall@k, latency, and cost-per-task evaluation before every deploy.

03 / Built for Deep Focus

Read at your speed. Ship as you go.

No 40-minute rambling videos to scrub through when you need one code pattern. Every lesson combines clear intuition, copy-ready Python, and embedded video walkthroughs.

INTERACTIVE LESSON PLAYER

Code + Expected Output + Pitfalls

Every concept is paired with minimal runnable Python, real token/cost numbers, and “Watch out” callouts from production incidents.

Open sample lesson: Next-Token Prediction →
250+ AI INTERVIEW QUESTIONS

AI System Design & JD Prep

Practice deep technical questions on RAG trade-offs, agent orchestration, MCP, and evaluation with company-specific tracks.

Launch AI Interview Prep ↗

04 / The Path

The AI Developer Roadmap.

Eight stages from your first Python script to shipping production AI products. Start at stage one, or jump in wherever you are — each free course maps to a stage.

AI Developer Roadmap in 8 stages: 1 Foundations (Python, Git and GitHub, Linux, problem solving); 2 AI/ML Basics (math for ML, Pandas and NumPy, ML algorithms, model evaluation); 3 GenAI and LLMs (LLM fundamentals, prompt engineering, function calling, RAG basics, model APIs); 4 RAG (architecture, vector databases, embeddings, chunking and indexing, evaluation); 5 AI Agents (agent architecture, tool use, multi-agent systems, orchestration, memory and planning); 6 Azure AI Foundry (model deployment, RAG with Azure AI Search, agents and tools, monitoring); 7 MLOps (model versioning, CI/CD for AI, evaluation and observability, cost optimization); 8 Advanced and Specialization (fine-tuning, domain AI, production deployment, security and governance, end-to-end AI products).
  1. 01FoundationsFree course →
  2. 02AI/ML BasicsComing soon
  3. 03GenAI & LLMsFree course →
  4. 04RAGFree course →
  5. 05AI AgentsFree course →
  6. 06Azure AI FoundryFree course →
  7. 07MLOpsComing soon
  8. 08AdvancedComing soon

05 / Daily AI Writing

Latest frontier model & systems dispatches.

View all 144+ articles →
A bright daylit startup loft office with wooden desks, two laptops, stacked cardboard boxes and a whiteboard sketched with connected boxes and arrows, the headline OPENAI TO ACQUIRE PIERRE, the orange subline Code Storage features headed for Codex, and the AIWithRahish badge in the bottom-right corner
OPENAI · PIERRE · NOV 4, 2026

OpenAI to Acquire Pierre for Codex Code Tools

OpenAI says it will acquire Pierre Computer, maker of Code Storage and the Trees and Diffs libraries used in Codex; closing needs regulatory approvals.

A bright daylit airplane window seat with a smartphone, screen dark, resting on the tray table beside an open printed phrasebook, sunlit clouds outside the window, the headline PLAMO 3 TRANSLATE OPEN WEIGHTS, the orange subline Four sizes from 0.8B to 31B, and the AIWithRahish badge in the bottom-right corner
PFN · PLAMO 3 TRANSLATE · NOV 5, 2026

PFN Releases Open-Weight PLaMo 3 Translate Models

PFN released open-weight PLaMo 3 Translate in four sizes from 0.8B to 31B for offline use; commercial use is free with registration up to 1B yen revenue.

A bright daylit robotics research lab with a white workbench holding a green apple, a yellow screwdriver, a red toy block, a glass bottle, a roll of tape, a wooden spoon and a potted succulent beside a black stereo depth camera on a small tripod, the headline OPEN-SOURCE GROUNDINGPI, the orange subline Beat GPT-6 Astra in the team’s tests, and the AIWithRahish badge in the bottom-right corner
XPENG · GROUNDINGPI · NOV 4, 2026

XPENG Details Open-Source GroundingPI Perception Model

GroundingPI, a 4B open-source perception model from XPENG-affiliated and academic researchers, outscored GPT-6 Astra across 34 benchmarks in the team’s tests.

A smartphone with a dark screen lying on a light oak café table beside a cappuccino, a brown paper takeaway bag and a potted plant in bright window sunlight, the headline APPLE OPENS SIRI AI TO ALL DEVELOPERS, the orange subline Developer preview in the iOS 27.3 betas, and the AIWithRahish badge in the bottom-right corner
APPLE · SIRI AI · NOV 3, 2026

Apple Opens Siri AI to All Developers in iOS 27.3 Beta

Apple’s Developer Preview in the iOS 27.3 betas lets any app bring content and actions into Siri AI via App Intents, plus new skills for complex requests.

A bright, sunlit video production studio with a cinema camera on a tripod, two softbox lights and a vase-and-fruit product set on a teal backdrop, the headline FAL RAISES $1.3 BILLION, the orange subline At a $16B valuation, Bloomberg says, and the AIWithRahish badge in the bottom-right corner
FAL · SERIES F · NOV 3, 2026

Fal Raises $1.3B at $16B Valuation, Bloomberg Reports

Fal raised $1.3 billion in a Series F led by Bessemer at a $16 billion valuation, Bloomberg reported, as demand for its AI image and video inference grows.

A full-size terracotta clay model of a sleek sports coupe in a bright, sunlit design studio with tall windows and a pale grey floor, the headline OPENAI TEAMS UP WITH MAZDA, the orange subline AI explores ways to cut drag, and the AIWithRahish badge in the bottom-right corner
OPENAI · MAZDA · NOV 3, 2026

OpenAI Teams With Mazda to Test AI on Vehicle Design

OpenAI started a research collaboration with Mazda’s aerodynamics and crash-safety engineers and shared how GPT-6 Astra helps design physical products.

A bright midday aerial view of a flat-roofed light grey warehouse with rows of blue solar panels and small white rooftop units beside a green field and a canal, the headline TENCENT HY4 GAINS VISION, the orange subline Adds computer use at the same API price, and the AIWithRahish badge in the bottom-right corner
TENCENT · HY4 · NOV 4, 2026

Tencent Releases Hy4 With Vision and Computer Use

Tencent released Hy4, which adds vision and computer use for the first time, on Tencent Cloud and OpenRouter at the same API price as Hy4 preview.

Printed technical reports and pages of handwritten math on a sunlit oak table in a research room, with the headline Proving which model answered
ANTHROPIC · FLASHPROVE · NOV 2, 2026

Anthropic’s FlashProve Proves Which AI Model Answered

Anthropic open-sourced FlashProve, a research prototype that uses zero-knowledge proofs to show a reply came from a committed model without exposing weights.

Two bare circuit boards, one green and one black, on a sunlit wooden workbench beside a window, with a potted plant, coiled orange and black cables and a saffron cloth, the headline INDIAAI RELEASES EKA-1 AND DHĪR, the orange subline Dhīr built for offline use, and the AIWithRahish badge in the bottom-right corner
INDIAAI · EKA-1 · NOV 3, 2026

IndiaAI Releases EKA-1 and Offline-Capable Dhīr AI Models

IndiaAI Mission released Soket’s EKA-1, a 26.3B-parameter model for 22 Indian languages, and ZenteiQ’s open-source Dhīr 2B and 5B for offline use.

The sunlit San Francisco skyline seen across calm blue bay water with the Transamerica Pyramid, glass office towers and the Bay Bridge under a clear blue sky, the headline ANTHROPIC $895.4B COMPUTE COMMITMENTS, the orange subline About $447.5B expected by end of 2030, and the AIWithRahish badge in the bottom-right corner
ANTHROPIC · IPO · NOV 2, 2026

Anthropic Discloses $895.4B in Compute Commitments

Anthropic’s amended IPO filing lists about $895.4 billion in compute and infrastructure commitments and $17.0 billion in revenue in the September quarter.

Daylit exterior of a large modern exhibition hall in Barcelona, where CrowdStrike unveiled its AI Kill Switch at Fal.Con Europe
CROWDSTRIKE · FALCON GUARDIAN · NOV 3, 2026

CrowdStrike Launches AI Kill Switch to Stop Rogue Agents

CrowdStrike's Falcon Guardian AI Kill Switch can terminate a rogue agent first at the Gateway (endpoint soon), block relaunch, and cut network access.

A white wheeled mobile robot with a single arm lifts a cardboard case onto a stacked pallet in a bright, sunlit warehouse, with the headline TUTOR RAISES $75M, the orange subline Series B led by a16z and the AIWithRahish badge in the bottom-right corner
TUTOR INTELLIGENCE · A16Z · NOV 2, 2026

Tutor Intelligence Raises $75M to Scale Robot Workers

Tutor Intelligence raised a $75M Series B led by a16z, bringing funding to $117M to scale hourly Sonny and Cassie robot workers; valuation undisclosed.

A grey delta-wing fighter jet parked on a sunlit concrete airfield apron with a pine forest under a clear blue sky, the headline SAAB FLIES AI FIGHTER AGENTS, the orange subline Flight-tested on Gripen E, and the AIWithRahish badge in the bottom-right corner
SAAB · GRIPEN E · NOV 3, 2026

Saab Flies Its Own AI Agents on a Gripen E Fighter Jet

Saab says its in-house AI agents have flown on Gripen E, with an agent autonomously controlling the jet in beyond-visual-range combat scenarios.

A sunlit modern glass and timber office building on a landscaped campus plaza with young trees, terracotta planters and a long cedar bench under a blue sky, the headline CLAUDE API ADDS MESSAGE THREADS, the orange subline Long agent runs: median TTFT down about 35%, and the AIWithRahish badge in the bottom-right corner
ANTHROPIC · CLAUDE API · NOV 3, 2026

Anthropic Launches Message Threads for Faster Claude Agents

Anthropic's Claude API message threads beta sends only new messages each turn, cutting median time to first token about 35% on 500k-1M token requests.

A sunlit developer workspace with a closed silver laptop, a sage-green notebook with a pen, a white coffee cup and a potted succulent on an oak desk by tall windows overlooking a daylit city, the headline GEMINI 2.5 CALLS GET REROUTED, the orange subline Pro and Flash move to newer models Dec. 1, and the AIWithRahish badge in the bottom-right corner
GOOGLE · GEMINI API · NOV 3, 2026

Google Will Auto-Route Gemini 2.5 Pro and Flash Calls Dec. 1

Google has deprecated Gemini 2.5 Pro and 2.5 Flash. From Dec. 1, 2026, API calls to them will automatically route to newer models at their rates.

A sunlit electrical substation and high-voltage transmission towers crossing green countryside with pine trees and a large grey campus building under a blue sky, the headline OPENAI GRID PROTECTORS, the orange subline Up to 1,000 MW flexible demand in Georgia, and the AIWithRahish badge in the bottom-right corner
OPENAI · GEORGIA POWER · NOV 3, 2026

OpenAI Launches Grid Protectors to Cut Peak Power Use

OpenAI's Grid Protectors Program will have future compute campuses cut power use when grids are strained, starting with up to 1,000 MW in Georgia.

A sunlit home office with a light wooden desk by a window holding a closed silver laptop, a stack of plain notebooks, a white coffee mug and potted plants, the headline ONE ROBOTS.TXT AI TRAINING SWITCH, the orange subline Google, OpenAI and Microsoft back it, and the AIWithRahish badge in the bottom-right corner
GOOGLE · OPENAI · MICROSOFT · NOV 2, 2026

Google, OpenAI and Microsoft Back One AI Training Opt-Out

Google, OpenAI and Microsoft plan to honor one shared robots.txt signal that lets websites opt out of AI training across participating providers at once.

A sunlit white desk by a window with a closed silver laptop, a teal mechanical keyboard, a closed spiral notebook, a coffee mug and a whiteboard of blank pastel sticky notes, the headline DEEPSEEK SHARES SUPER-AGENT CODE, the orange subline An MIT-licensed research prototype, and the AIWithRahish badge in the bottom-right corner
DEEPSEEK · NOV 2, 2026

DeepSeek Open-Sources a Super-Agent Coding Prototype

DeepSeek has open-sourced dsh-superagent, an MIT-licensed research prototype of a coding agent that takes requests on GitHub and replies with pull requests.

A sunlit oak table by a window with potted plants, holding a grey wearable sensor glove with cables, a head-mounted camera rig, a folded blue towel, a white mug and a wooden tray, the headline GENROBOT AI RAISES $100M, the orange subline Series A+ for robot training data, and the AIWithRahish badge in the bottom-right corner
GENROBOT AI · NOV 2, 2026

GenRobot AI Raises $100M Series A+ for Robot Training Data

GenRobot AI, a Beijing robot-training data firm, raised a $100M Series A+ backed by SAIC Motor, Baidu and others to scale human demonstration data.

A sunlit oak table by a tall window overlooking a city skyline, with a smartphone with a blank dark screen, a white earbuds case and a cup of green tea, the headline APPLE INTELLIGENCE IS COMING TO CHINA, the orange subline With Qwen support, via iOS 27.3 in Dec., and the AIWithRahish badge in the bottom-right corner
APPLE · NOV 2, 2026

Apple Intelligence Is Coming to China With Alibaba's Qwen

Apple says Apple Intelligence testing in China starts Nov. 4, with a December launch via iOS 27.3 and Alibaba's Qwen support in Siri and Writing Tools.

A sunlit wooden desk by a window with a closed silver laptop, an open sketchbook of pencil-drawn cubes and a white architectural city model, the headline MEITUAN LAUNCHES LONGCAT-2.5, the orange subline 1.6T parameters, about 48B active, and the AIWithRahish badge in the bottom-right corner
MEITUAN · NOV 2, 2026

Meituan Launches LongCat-2.5, a 1.6-Trillion-Parameter Model

Meituan released LongCat-2.5, a natively multimodal model with 1.6 trillion parameters built for long-horizon coding and agent tasks, via chat and API.

The Abu Dhabi Corniche skyline in bright daylight, seen across calm turquoise water with a palm-lined beach, with the headline ABU DHABI SIGNS 4 OPENAI DEALS in bold white, the orange subline Government, ADNOC & Mubadala, and the AIWithRahish badge in the bottom-right corner
OPENAI · NOV 2, 2026

Abu Dhabi Signs Four AI Deals With OpenAI, Including ADNOC

Abu Dhabi entities signed four agreements with OpenAI covering ADNOC, Mubadala, Inception42 and a machine-readable government pilot on UAE-hosted GPUs.

A sunlit home office desk with a closed silver laptop, a white keyboard, an open blank planner with a pencil and a glass of water, with the headline CHATGPT & CODEX SHARE ONE LIMIT in bold white, the orange subline Token-based usage from December, and the AIWithRahish badge in the bottom-right corner
CHATGPT · NOV 2, 2026

ChatGPT and Codex Will Share One Usage Limit in December

OpenAI says Plus, Pro and Business plans will share one token-based usage allowance across ChatGPT and Codex from December; Instant chat won't count.

OpenAI agent monitoring
AI SAFETY · OCT 30, 2026

OpenAI Expands Agent Monitoring After Hugging Face Incident

How frontier labs are instrumenting autonomous coding and research agents for misalignment in real time.

Mistral Large 4
OPEN WEIGHTS · OCT 30, 2026

Mistral Opens Up Large 4, Its 1-Trillion-Parameter MoE Model

Architecture breakdown, active parameter routing, and serving economics for self-hosted enterprise stacks.

Cohere Series E
ENTERPRISE AI · OCT 30, 2026

Cohere Targets C$7B Series E at C$35.7B Valuation

Why sovereign AI, private VPC deployments, and enterprise retrieval are driving Cohere’s next growth wave.

How Transformers Work
DEEP DIVE · SYSTEMS

How Transformers Actually Work — From Attention to KV Cache

A visual, math-grounded walkthrough of self-attention, RoPE, KV caching, and prefill vs decode bottlenecks.

Read the blog

More than 140+ Deep-Dive Articles on AI with Rahish Blog.

Daily engineering breakdowns on frontier LLMs, RAG architectures, agent security, and production benchmarks. Read the latest posts and system notes.

Explore All Blog Posts
Youtube banner