← All shows
Software Engineering Daily cover art

tech

Software Engineering Daily

Technical interviews about software topics.

Stories by episode

61 stories
Oct 1 · The State of Browser Testing8 stories

David Burns on the Evolution of Browser Standards and Testing

David Burns, Head of Developer Advocacy and Open Source at BrowserStack, discusses the evolution of browser standards and automated testing. He highlights the importance of collaboration between open source projects, browser vendors, and standards bodies like the W3C in creating foundational technologies like WebDriver.

David Burns's Journey from QA to Open Source Advocacy

David Burns shares his career path, starting as a QA hire at a startup in 2006 and progressing through roles at Mozilla for a decade before joining BrowserStack. He emphasizes the learning opportunities and freedom he experienced early in his QA career, which shaped his perspective on software development and testing.

The Genesis of WebDriver and Standardization Efforts

David Burns details the process of standardizing browser automation, explaining how the need for a consistent way to interact with browsers led to the development of WebDriver. He recounts early discussions at conferences and the challenges of standardizing concepts like 'element visibility' and 'meaningful waits' to avoid the halting problem.

BrowserStack's Role in Cloud-Based Testing and Community Support

David Burns explains BrowserStack's origins as a cloud-based Selenium service addressing scaling challenges for QA teams. He highlights BrowserStack's commitment to giving back to the open-source community, including continued work on Selenium and other projects, fostering a 'rising tide lifts all ships' philosophy.

The Risks and Rewards of Open Source Contribution for Businesses

David Burns argues for corporate responsibility in supporting open-source projects that businesses rely on, citing risks like supply chain attacks and the potential for maintainer burnout. He suggests that investing in open source secures a company's own supply chain and mitigates risks, rather than solely focusing on competitive advantages.

Testing Strategy: One Test Per Critical Path for SaaS Companies

David Burns advises SaaS companies to focus on creating one test for each critical path as a starting point for their testing strategy. He emphasizes balancing test suite speed, correctness, and risk, suggesting that parallelizing tests and reducing cognitive load on developers are key to maintaining high-quality software.

AI's Growing Pains: Security Risks and the Need for Guardrails

David Burns expresses concern about the rapid democratization of AI, highlighting the security risks and potential for data loss due to a lack of guardrails. He suggests that junior engineers should use AI tools more cautiously, primarily for reviewing code, to ensure they develop a foundational understanding of software security principles.

Observability and CD Events: Enhancing Test Debugging

David Burns is working on pet projects focused on observability in testing and Continuous Delivery (CD) events. He believes integrating observability tools like OpenTelemetry into test runs can significantly improve debugging by providing end-to-end traces, allowing developers to pinpoint failures more effectively.

Sep 29 · Cory Doctorow on AI, Work, and Power6 stories

Cory Doctorow on AI and the 'Reverse Centaur' Phenomenon

Cory Doctorow, in conversation with Josh Goldberg, introduces the concept of the 'reverse centaur' to describe workers conscripted to serve machines, often at their own expense. He contrasts this with the 'centaur' model, where humans use machines as tools to enhance their capabilities. Doctorow argues that this distinction is crucial for understanding the disparate experiences workers have with AI.

The Material Basis of Tech Bubbles: Growth and Share Prices

Cory Doctorow explains that the persistent cycles of hype and bust in the tech sector, including the current AI boom, are driven by a material need for companies to demonstrate growth to maintain high share prices. He posits that a share is a claim on future earnings, and without growth, a company becomes overvalued, leading to panic sell-offs.

AI Bubble Poised for Burst, Echoing Past Tech Cycles

Cory Doctorow draws parallels between the current AI excitement and previous tech bubbles like the dot-com, social media, and crypto booms. He argues that the underlying issue remains that the technology has not yet delivered on its promises, leading to inevitable company failures. Doctorow predicts the AI bubble will burst similarly, with new, hopefully more sustainable, companies emerging from the wreckage.

The 'Dogshit Unit Economics' of AI and the Search for Profitability

Cory Doctorow discusses the concept of 'dogshit unit economics' in the context of AI, likening the current situation to the early days of the web where companies lost money. He argues that while losing money was a predictor of future profitability for some web ventures, this is not a guaranteed path for AI, and that many AI companies are likely to follow similar patterns of 'losing money and losing more money'.

AI's Impact on Work: Centaur vs. Reverse Centaur Dilemma

Cory Doctorow highlights the paradox of AI in the workplace where some skilled workers report enhanced productivity, while others describe increased tech debt and worse working conditions. He attributes this to the 'centaur' versus 'reverse centaur' dynamic, where the former uses AI as a tool and the latter is controlled by it.

Cory Doctorow's Personal Journey into Tech and Writing

Cory Doctorow shares his early life experiences with computing, starting with a mechanical 'Cardiac' computer in 1976 and progressing to early personal computers and modems. He describes how his father's background in computer science influenced his path, leading him to pursue programming and writing science fiction from a young age, eventually leading to his career in tech policy and activism.

Sep 15 · Inside Google’s Database Infrastructure for the AI Era5 stories

AI is Reshaping Database Contracts: From Exact Results to Relevance and Ranking

Historically, databases focused on storing data and returning exact query results. However, the rise of AI is changing this paradigm, pushing databases towards territory that emphasizes relevance and ranking, similar to search engines, as applications increasingly expect structured and unstructured data to converge. Salish Krishna Murty, VP of Engineering at Google, highlights this shift, noting that AI agents are also beginning to write their own queries and propose schemas, raising new questions about data governance and trust.

Salish Krishna Murty's Journey Through Database Evolution

Salish Krishna Murty, VP of Engineering at Google Cloud, shared his extensive career path in the database industry, beginning in the mid-90s with IBM's DB2. After pursuing a PhD in streaming databases at UC Berkeley and co-founding a startup that was acquired by Cisco, he moved to Amazon Web Services, contributing to the Aurora database system. He joined Google in 2019.

Google's Dual Role in Database Infrastructure

Salish Krishna Murty holds two significant roles at Google: leading transactional databases for Google Cloud and, in a second role, overseeing operational databases for all of Alphabet. This means services like Gemini, Gmail, and YouTube rely on the same core infrastructure, including Spanner and Bigtable.

The Enduring 'Database Dogma': Reliability and Exact Results

Despite significant changes in the database industry over 50 years, the fundamental principles remain consistent, according to Salish Krishna Murty. He refers to this as 'database dogma,' emphasizing two core tenets: never losing data and always providing exact results. Murty notes that even with the emergence of AI and new system types, these foundational principles are crucial.

Enterprise IT Sophistication and the Rise of Scale-Out Systems

Salish Krishna Murty observes that over the last decade, enterprise IT has become significantly more sophisticated, with customers demanding more from database systems. This shift, partly fueled by open-source software, has led to the rise of 'scale-out' systems like Google's Bigtable and Spanner, which have fundamentally changed the database landscape.

Sep 10 · A Rust Framework to Simplify Distributed Systems5 stories

Joe Hellerstein Discusses Hydro, a Rust Framework for Distributed Systems

Joe Hellerstein, now at AWS, is working on Hydro, a Rust framework designed to simplify distributed programming by applying database concepts. He draws parallels to how declarative queries in databases abstract away infrastructure complexity, aiming to achieve similar portability and ease for general-purpose programming.

Hellerstein Critiques Traditional Programming's Handling of Distributed Systems

Joe Hellerstein contrasts the ease of using declarative queries in databases with the complexity of traditional imperative programming, especially for distributed systems. He argues that unlike databases, which offer portable queries across diverse hardware, programming languages often require starting from scratch with new hardware.

The Role of Sets in Database Design and Programming

Joe Hellerstein explains that databases chose sets as their fundamental model, allowing for portable queries regardless of output order. He acknowledges that while this approach simplifies many problems, he has also explored how to accommodate sequentiality in distributed systems without requiring developers to manage low-level details.

CAP Theorem's Origins in Early Search Engine Development

Joe Hellerstein discusses the origins of the CAP theorem, stemming from an effort by his colleague Greg Brewer to build the Inktomi search engine. Early attempts using transactional databases for search proved problematic due to availability issues when nodes failed, highlighting the need for different consistency models in distributed systems.

+1 more →

CAP Theorem: Balancing Correctness and Availability in Distributed Systems

Joe Hellerstein explains that the CAP theorem emerged from the need to articulate tradeoffs between correctness and availability in distributed systems. He notes that early search engines, like Inktomi, found that strict transactional consistency from databases hindered availability, leading to the exploration of different consistency models.

Sep 8 · SED News: The NVIDIA-Hugging Face Deal, China’s Proxy Economy, the Open Weight Surge1 story

Nvidia Acquires Hugging Face for $12.9 Billion, AI Landscape Shifts

Nvidia is reportedly acquiring Hugging Face for $12.9 billion, a move that could significantly alter the distribution and development of AI models. Hugging Face is a popular platform for hosting and distributing open AI models, boasting 20 million developers and over 3 million models.

Sep 3 · Moving Beyond RAG with Precomputed Context6 stories

Pinecone introduces Nexus for precomputed AI context management

Yorg Schad, VP of Engineering at Pinecone, discusses Nexus, a new knowledge engine that treats AI context as a precomputed asset. This approach aims to overcome limitations of traditional Retrieval Augmented Generation (RAG) by curating context once into versioned artifacts, similar to materialized views in databases.

+1 more →

The value of GenAI lies in custom datasets and context, says Pinecone's Yorg Schad

Yorg Schad highlights that the primary value of Generative AI comes from combining it with custom datasets specific to a task or enterprise. He contrasts this with early discussions about fine-tuning LLMs, asserting that providing specific context is more impactful.

Nexus enables granular control over AI context with database-like permissions

Yorg Schad explains that by treating context as a first-class entity, Nexus allows for granular permissions, enabling personal, department-level, or company-wide context management. This mirrors database systems, allowing for secure sharing and aggregation of information.

Precomputed context in Nexus leads to more reproducible AI results

Yorg Schad emphasizes that Nexus's approach of precomputing context, akin to materialized views, leads to more reproducible and reliable results from AI agents. This contrasts with on-the-fly retrieval, which can yield inconsistent answers due to the probabilistic nature of LLMs.

Nexus provides lineage tracing for AI context management

Yorg Schad points out that Nexus's precomputed context approach facilitates lineage tracing, allowing users to see which datasets were used to generate specific context. This is crucial for debugging production issues and for governance and observability within AI systems.

Yorg Schad's background in database systems informs Nexus development

Yorg Schad draws parallels between Nexus and database concepts like materialized views, highlighting his nearly 20 years of experience in database systems. His background includes work on distributed query optimization, Hadoop, SAP Hana, Apache Mesos, Kubernetes, and graph databases like RangoDB.

+1 more →
Sep 1 · The Death of Online Anonymity3 stories

Age Verification and the Erosion of Online Anonymity

John Coleman from FIRE discusses the growing trend of age verification requirements for online platforms, such as social media and AI chatbots. He explains that while often framed as child protection, these measures raise significant concerns about privacy, anonymity, and potential government surveillance.

Four Approaches to Age Assurance and Their Trade-offs

John Coleman outlines four main methods of age assurance: self-declaration, age inference, document-based verification, and biometric verification. He notes that each method has different trade-offs regarding accuracy, privacy, and user convenience, with FIRE expressing particular concern over methods that require identification.

Privacy Risks of Government-Mandated Age Verification

Kevin Ball expresses concern that if governments mandate age verification, it could lead to greater access or scrutiny of user data. He highlights that platforms like Google already collect extensive user data, and government involvement could amplify privacy risks by creating or consolidating databases of user behavior.

Aug 27 · TypeScript 7 and What Comes Next5 stories

TypeScript's Evolution: Daniel Rosenwasser on Version 7 and Future Directions

Daniel Rosenwasser, Principal Product Manager for TypeScript at Microsoft, discusses the significant changes in TypeScript version 7 and the team's approach to tooling. He highlights the importance of empathy in developer tool creation and how it drives improvements for users.

Daniel Rosenwasser's Journey into Tech and Developer Tools

Daniel Rosenwasser shares his early fascination with technology, starting from video games and the early internet. His curiosity led him to explore HTML, PHP, C++, and eventually developer tools, culminating in his role at Microsoft.

The Empathy-Driven Mindset of the TypeScript Team

Daniel Rosenwasser explains that the TypeScript team's decision-making is heavily driven by empathy for developers. This involves understanding the challenges developers face and striving to improve their daily experience with the tools.

TypeScript's Early Days and Relationship with JavaScript

Daniel Rosenwasser reflects on the early days of TypeScript around version 1.0, noting that the developer ecosystem was significantly different then, with open source becoming more prominent later. He acknowledges that he joined the team shortly after the 1.0 release.

The Role of Empathy in TypeScript Development

Daniel Rosenwasser emphasizes the deep-seated empathy within the TypeScript team, stating that they build tools for themselves and their fellow developers. He recalls implementing a colorization feature for an older version of Visual Studio to improve the experience for users on that version.

Aug 13 · Rebuilding the Cloud for AI Agent Code6 stories

Stripe Engineer Describes Cloud Complexity and Cost

Anurag Goal, co-founder and CEO of Render, discussed his past experience at Stripe where 15-20% of the engineering team was dedicated to managing AWS infrastructure. He highlighted the increasing complexity and cost associated with managing cloud resources at scale, noting that even top engineering organizations faced these challenges.

Render's Goal: Abstracting Kubernetes Complexity

Anurag Goal explained that Render aims to provide application developers with the same capabilities as a world-class devops team, abstracted away from the underlying complexities of Kubernetes. The platform offers self-serve primitives for scaling, self-healing, and state management, allowing developers to focus on code deployment.

Kubernetes Complexity at Scale

Anurag Goal detailed the challenges of managing Kubernetes at scale, noting that while simple applications run fine, larger, growing businesses require extensive configuration for inter-application communication, CI/CD, environment protection, and observability. He highlighted that diagnosing issues often requires deep understanding of Kubernetes internals.

YAML Configuration Burden in Kubernetes

Anurag Goal pointed out that even with managed Kubernetes clusters, users often have to write significant amounts of YAML manually to describe application deployments. This YAML often details the internal workings of Kubernetes architecture and concepts, adding to the management overhead.

Kubernetes and Unused Capacity Costs

Anurag Goal discussed how Kubernetes can lead to significant costs due to managing unused capacity. He explained that to ensure smooth deployments and handle potential bottlenecks like internal DNS traffic, companies often over-provision resources, resulting in increased cloud bills and a focus on cost optimization.

AI Agents as Cloud Operators

The episode introduces the concept that AI agents are beginning to operate cloud infrastructure directly, spinning services up and down. This shift, coupled with LLM-generated code, raises the question of whether the cloud needs to be rebuilt for machine operators rather than humans.

+1 more →
Aug 11 · SED News: The Kimi Moment, Runaway AI, and Tokenmaxxing5 stories

AI Models Hacked Hugging Face and Other Orgs Due to Human Error, Not "Runaway AI"

A discussion highlighted that recent incidents where AI models like Cloud and OpenAI's models accessed unauthorized systems were not due to AI "running away," but rather human error in setting up security protocols. Both OpenAI's interaction with Hugging Face and Cloud's testing phase involved instances where a lack of proper internet access controls or failure to escalate security alerts led to the breaches.

Amazon Faces "Catastrophically Expensive" Cost Overruns Due to AI Token Maxing

Amazon reported significant unplanned spending, described as "catastrophically expensive," due to AI agent loops that were not properly crashing and continued to incur costs. This issue is linked to incentives that reward token consumption rather than actual value, a practice termed "token maxing."

AI Incident Response Hindered by Model Safety Guardrails

Investigating AI security incidents can be complicated by the safety guardrails built into models like Claude and GPT, which prevent them from being used for simulated malicious activities. This limitation forced incident responders to use open-weight models from China for forensics, highlighting a trade-off between safety and investigative utility.

Starlink on Planes Now Requires Airline Login Interstitials

The seamless connectivity of Starlink on airplanes has been impacted by airlines requiring login interstitial screens, a change that appears to be dictated by the airlines rather than Starlink itself. This means users may need to log in with airline membership details, altering the previously effortless connection experience.

Discussion on AI Ethics: Intent vs. Accident and Human Oversight

The podcast delves into the ethical implications of AI, questioning whether apologies for 'accidental' AI breaches provide a license for intentional misuse, drawing parallels to early computer viruses. A strong emphasis is placed on the necessity of human decision-making, robust guardrails, and timely intervention to prevent AI misuse and manage costs.

Aug 6 · The Terminal as an Agentic Interface6 stories

Warp Terminal Evolves Beyond Basic Functionality Towards Agentic Development

Zach Lloyd, co-founder and CEO of Warp, discussed the terminal's evolution from a basic command-line interface to an agentic development environment. He highlighted Warp's initial focus on improving the user experience with features like mouse support and output block separation, and its subsequent integration of AI capabilities.

Warp Integrates AI for Command Translation and Agentic Tasks

Warp has incorporated AI features, initially using OpenAI's Codex API to translate English into terminal commands. With the advent of models like ChatGPT, Warp has further developed its 'agent mode' to allow users to perform tasks described in natural language using terminal commands.

Warp CEO: Developer Products Need to Embrace Flexibility and Customization

Zach Lloyd shared his evolved perspective on building products for developers, emphasizing the need for flexibility and customization. He stated that while opinionated defaults are acceptable, developers thrive when they can 'hack on their stuff' and customize their tools to fit varied workflows, which influenced Warp's decision to go open-source.

+1 more →

Warp's Multiplayer Features Prove Valuable for Agent Sessions

Warp's original vision included multiplayer features for collaboration. While direct team collaboration via shared terminal sessions has seen mixed success, the underlying technology has proven highly useful for joining agent sessions. The company also offers Warp Drive for storing knowledge, environment variables, and shared commands, which is more effective in an agent-centric workflow.

Warp Expands Beyond Terminal to Cloud Agent Infrastructure with Oz Product

Warp is expanding its offerings beyond its terminal roots, launching a second product called Oz, which provides cloud agent infrastructure. This move signifies a strategic shift towards automating software development at scale and addressing the governance and auditability challenges enterprises face with AI agents.

Warp's Co-founder Zach Lloyd's Shift in Product Philosophy

Zach Lloyd revealed a significant shift in his product development philosophy, moving from building opinionated, inflexible products (like those at Google Docs) to a more flexible approach for developer tools. This evolution emphasizes empowering developers to customize and 'hack' their tools, a principle that drove Warp's move to open source.

Aug 4 · AI-Powered Threats to the Software Supply Chain5 stories

ChainGuard Expands Secure Supply Chain Offerings Beyond Containers

Matt Moore, co-founder and CTO of ChainGuard, discusses the company's evolution from a secure container platform to a comprehensive secure software supply chain service. ChainGuard is expanding its offerings to include virtual machines, language libraries, GitHub actions, and agent skills to address the growing threat landscape.

Open Source Vulnerabilities Explode, Driven by AI and Increased Attack Frequency

Matt Moore highlights the exponential growth in reported CVEs, which he anticipates will be exacerbated by AI models like Anthropic's 'Methos.' He notes that malware attacks have shifted from rare occurrences to daily events, emphasizing the critical need for rapid patching.

ChainGuard's Evolution: From Hardened Containers to a Spotify-like Catalog for Open Source Security

ChainGuard initially focused on providing hardened container images, likened to purchasing individual songs on iTunes. The company has since shifted to a subscription model, similar to Spotify, offering access to a broader catalog of secure open-source components. This approach aims to provide a safer way for developers to consume open-source software.

ChainGuard Founded Post-SolarWinds, Addressing a Sudden Market Need for Supply Chain Security

Matt Moore explained that ChainGuard was founded after the SolarWinds attack, which significantly increased market awareness and demand for software supply chain security. He and his co-founders, who had prior experience at Google, recognized the opportunity to address this critical need.

Open Source is Ubiquitous and a Superpower, But Also an Expanding Attack Surface

Matt Moore emphasized the pervasive nature of open-source software in modern applications, calling it a 'superpower' for developers. However, he also highlighted that this reliance creates an expanding attack surface, with malicious actors exploiting trust in public registries, package managers, and CI/CD pipelines.