Data curation complexity and costs in enterprise AI systemsRisk of economic disruption from poorly integrated AI models at scaleSIGPfB framework positioning: Protocol Consulting, Design, and EngineeringAI agents as analysts and researchersResearch archetypes and cognitive modes (Naturalists, Engineers, Managers)

Participants: rafa_0x, timber1997, sachbenny, drevius., .unipuff

The SIGPfB group convened to discuss enterprise AI protocols and business applications. Participants analyzed the hidden complexity of data curation in AI systems, noting that memory costs and software layers create enormous expenses for bespoke LLM development, with only marginal gains justifying custom stacks as standardized solutions mature. The group debated systemic risk from model rollouts at scale and discussed the vulnerability of deeply integrated AI systems. They refined their working framework for protocol-focused work into three main categories: Protocol Consulting (client-facing advisory), Protocol Design (technical protocol specifications like auction models), and Protocol Engineering (implementation work like AI orchestration layers). Discussion shifted toward AI agents functioning as analysts and researchers. Late in the thread, participant .unipuff revealed convergence with their PhD thesis research on research archetypes, proposing a typology based on cognitive modes and styles (Naturalists with vertical cognition, Engineers and Managers with horizontal cognition) rather than operational functions alone, suggesting important complementarities across research approaches.

  • Data curation after collection involves numerous software layers and represents a major cost center for enterprise AI vendors, similar to hidden complexity in everyday technology like microwaves.
  • Bespoke LLM stacks have enormous marginal costs, but marginal gains may justify investment; eventually standardized phenotypical stacks will emerge with diminishing returns to customization.
  • The group's framework distinguishing Protocol Consulting, Design, and Engineering converges with academic research on research archetypes based on cognitive modes (vertical vs. horizontal) rather than operational distinctions alone.
  • Research archetypes are epistemically important and function through tensions and complementarities rather than simple trade-offs between different cognitive styles and work environments.
View discussion in Discord →