Typesafe AI Daily, August 29, '26
TOTVS puts the agent debate where production teams actually feel it: semantic data models, MCP tool boundaries, latency, privacy, and token cost.
The most consequential shift is that enterprise AI agents are becoming data-architecture projects, because token cost, latency, privacy, and correctness now depend on schemas, semantic models, and tool boundaries rather than prompts alone.
If you build typed AI systems, today’s lead is not another model release. It is Fabiane Nardon’s InfoQ presentation on how TOTVS prepares enterprise data for AI agents: transactional systems, semantic ontologies, low-latency database access, and dynamic MCP tool selection. That is where agents either become maintainable software or expensive improvisation.
Lead story: TOTVS frames agents as a data-layer problem
Fabiane Nardon of TOTVS used an InfoQ presentation, Architecting the Data Layer for AI Agents: From Transactional Systems to MCP and Semantic Models, to describe how TOTVS prepares enterprise data for token-hungry AI agents. The concrete ingredients are worth naming: data mesh, low-latency database architectures, semantic ontologies, and dynamic Model Context Protocol tool selection. Nardon also puts a hard constraint around the enthusiasm: enterprise teams have to balance deterministic business logic with non-deterministic LLM behavior across precision, security, and cost.
That is a more serious framing than agent demos that simply bolt a model onto a database. In Nardon’s account, the agent’s usefulness depends on how much context it can avoid carrying, how safely it can choose tools, and how clearly enterprise data has been modeled before the model ever sees it. The affected teams are not just AI app developers; they are database engineers, enterprise architects, platform teams, and security reviewers who own the systems of record.
Why a serious engineer should care
The engineering issue is boundary design. If an agent can call every tool with a giant context window, your bill and blast radius grow together. TOTVS’s described approach points in the opposite direction: keep transactional systems deterministic where they need to be deterministic; use semantic models to compress meaning; use low-latency database paths so retrieval does not become a user-facing bottleneck; and select MCP tools dynamically rather than stuffing every possible capability into the prompt.
That lines up with the rest of today’s infrastructure tape. NVIDIA says agentic workloads can consume far more tokens than simple chat, while Cloudflare is packaging AI Search as a way to point agents at private files and websites without assembling lower-level primitives by hand. Hugging Face’s multi-vector embedding work is another version of the same pressure: retrieval quality and representation shape matter when context is expensive.
Sources: NVIDIA — Vera Rubin NVL72 efficiency for AI agents, Cloudflare — AI Search for agents, Hugging Face — Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers, Hugging Face — Multi-Vector Embedding Models with Sentence Transformers
Why a founder or VC should care
The capital angle is that agent infrastructure is moving from model novelty to deployment control. OpenAI is talking about the full stack of chips, compute, models, and products, and says its Jalapeño custom inference chip is aimed at faster, more power-efficient inference. NVIDIA is selling rack-scale efficiency for agentic workloads. Cloudflare is turning enterprise search for agents into a product surface. Socure raised $156 million in a strategic growth investment at a $5.2 billion valuation and is acquiring agentic AI fraud investigation startup Fravity, which Socure says will be incorporated into its RiskOS platform as RiskOS_Agents.
That is the competitive map: inference cost, private data access, workflow-specific agents, and distribution through existing enterprise platforms. The investor names behind Socure’s strategic growth investment were not provided in the supplied source summary, so the confirmed capital vehicle here is the strategic growth investment itself. The named companies to watch are TOTVS, OpenAI, NVIDIA, Cloudflare, Hugging Face, Socure, and Fravity.
Sources: OpenAI — Jalapeño’s first results, OpenAI — The full stack behind abundant intelligence, NVIDIA — Vera Rubin NVL72 efficiency for AI agents, Cloudflare — AI Search for agents, Crunchbase News — Socure secures $156M and acquires Fravity
The wider tape
- OpenAI is tightening the privacy and distribution story. The company reaffirmed Zero Data Retention for eligible API customers and previewed Private Safety Processing. Separately, OpenAI said it will wind down its contract providing OpenAI models to Cursor following Cursor’s acquisition by SpaceX. That is a reminder that model access is also a business-control surface, not just an API call. Sources: OpenAI — Offering Zero Data Retention for frontier models, OpenAI — Decision on Cursor following its acquisition by SpaceX
- NVIDIA is pushing local and rack-scale agent infrastructure at the same time. NVIDIA highlighted open source local AI models and agents, expanded the Nemotron 3 family with Nemotron 3.5 Lightning and NeMo Switchyard, and described Vera Rubin extensions for inference-heavy agent systems. The marketing is grand, but the technical bet is specific: long-running agents make throughput, memory movement, and tokens-per-watt first-order product constraints. Sources: NVIDIA — Open source models and intelligent agents, NVIDIA — Nemotron 3.5 Lightning and NeMo Switchyard, NVIDIA — Vera Rubin inference for agents
- Typed data substrates are getting practical attention below the AI layer. A Medium post describes building an Apache Arrow ADBC driver spanning ODBC databases, 46 databases, and 5 languages. Another post argues Delta Lake users should stop overwriting tables just to add a column, with production concerns around Databricks, Change Data Feed, Unity, and transaction logs. These are not flashy agent features, but they are the substrate that keeps AI systems from becoming pileups of bespoke adapters. Sources: Medium — Apache Arrow ADBC driver for every ODBC database, Medium — Stop Overwriting Your Delta Tables Just to Add a Column
- Pydantic, Instructor, Dagster, and HelixDB show the developer-level version of the same move. Pydantic AI is being discussed as typed agent infrastructure; an Instructor/Pydantic dev.to writeup describes a local-inference LLM pipeline for ad creative evaluation with strict contracts and binary compliance scoring; a Dagster post adds asset staleness metrics to a Prometheus exporter; and HelixDB Query Insights gives graph-database operators something to inspect. Thin evidence individually, useful signal together: developers are asking for typed outputs, observable data assets, and inspectable graph queries. Sources: Pydantic — Pydantic AI overview, dev.to — Reliable LLM pipeline with strict Pydantic contracts, dev.to — Dagster Prometheus exporter asset staleness metrics, HelixDB — Query Insights
- Research is probing where explanations and clinical data schemas meet. One arXiv feasibility study compares a standalone LLM with a pre-specified agentic pipeline for explaining ICU mortality predictions on the eICU Demo Dataset, reporting 2,353 ICU stays, 8.1% mortality, and an XGBoost AUROC of 0.855 with a 95% CI of 0.796–0.906. Another introduces EEG-to-Report, a browser-based annotation and feature-text framework for building AI-ready EEG datasets. These are early research artifacts, not deployable clinical proof, but they sharpen the question: can agents produce explanations that are structured enough to audit? Sources: arXiv — ICU mortality explanation feasibility study, arXiv — EEG-to-Report
- Funding remains broad, but infrastructure is still in the money flow. Crunchbase News reported that the week’s biggest rounds included defense tech, AI tools, inference technology, a video-creation platform, data centers, and voice-to-text tools, with Castelion named as the largest round in that roundup. The relevant read for typed AI builders: capital is still backing the physical and operational layers that make agent products feasible. Source: Crunchbase News — The Week’s 10 Biggest Funding Rounds
- Composable agent research is still fighting the inertia problem. An arXiv paper, From Inertia to Objectivity: Improving Deep Research Agents with Noise Isolation, argues that web-search agents can get stuck once they have produced a query, plan, or intermediate conclusion. That is exactly why typed, inspectable intermediate state matters: if the system cannot show what it believes and why, it is hard to correct. Source: arXiv — From Inertia to Objectivity
- DataFusion is nearing another release checkpoint. Apache DataFusion 55.0.0-rc1 was tagged with the version update and generated changelog. For teams standardizing on Arrow-native execution, release candidates like this are worth watching even when the announcement itself is mostly procedural. Source: Apache DataFusion 55.0.0-rc1
- Hugging Face and Amazon are also tying collection, training, and deployment loops together. A Hugging Face post covers recording, training, and deployment with Strands Agents, LeRobot, and Hugging Face Storage Buckets. For robotics and embodied-agent teams, the notable piece is the loop: data capture, training data storage, and deployment are being packaged closer together. Source: Hugging Face — Strands Agents, LeRobot, and Storage Buckets
What to watch
- Will TOTVS or InfoQ publish implementation details beyond the presentation? The falsifiable signal is concrete MCP tool-selection logic, semantic model examples, latency numbers, or token-cost comparisons tied to transactional workloads. Source: InfoQ
- Will OpenAI and NVIDIA expose enough benchmark methodology to compare agent inference claims? Watch for workload definitions, model sizes, context lengths, throughput, latency, and power measurements for Jalapeño and Vera Rubin agent scenarios. Sources: OpenAI — Jalapeño, NVIDIA — Vera Rubin NVL72
- Will Cloudflare’s AI Search pricing preview become a concrete cost model? The practical question is whether teams can estimate indexing, query, storage, and agent-traffic costs before committing private data to the product path. Source: Cloudflare — AI Search
- Will Socure show named RiskOS_Agents deployments after absorbing Fravity? The claim to test is whether the acquisition becomes production fraud-investigation workflow inside RiskOS, not just agentic branding. Source: Crunchbase News — Socure and Fravity
- Will Pydantic AI and Instructor converge on repeatable typed-agent patterns? Watch for examples that survive retries, partial failures, schema evolution, local inference, and audit requirements without hand-written glue code everywhere. Sources: Pydantic AI, Instructor/Pydantic pipeline
The short version: agents are pushing cost and trust problems down into databases, schemas, retrieval, and hardware. That is good news for serious builders, because those layers can be measured.