- Jul 7, 2021 · 1 hr 42 min
- SEJul 7, 2021 · 4 min
Build Your Own Amazon
When I left Amazon, it was not out of resentment or dissatisfaction. It was out of education. At Amazon, one can learn how to build Amazon. Amazon was not built through master planning, but through incremental, adjacent expansion. Once you see how to expand from a book store to the backbone of the Internet, you see how to expand from anything to everything. And so I started a podcast. We are hiring for Software Daily and for a new company, Supercompute. If you are interested in working with us, send me an email: jeff@softwareengineeringdaily.com
- SEJul 6, 2021 · 58 min
Vanta: Maintaining Security Standards with Christina Cacioppo
SOC 2 is a security audit to prove that SaaS companies have secured their company and customer data. It’s often considered the minimum audit necessary to sell software. HIPAA is a federal law regulating how sensitive medical information about patients must be handled. ISO 27001 is the global benchmark for demonstrating your information security management system. What do these things have in common? They are all security standards that companies need to maintain and renew to be trustworthy to customers. They also take intense preparation with months of work, and hundreds of screenshots to prove compliance with auditors. The company Vanta provides automation tools to monitor your applications and maintain compliance. Fix items on your Vanta to-do list, and when you’re ready a Vanta-trained CPA will perform an audit with you. In this episode we talk with Christina Cacioppo, CEO at Vanta. We discuss the accreditation process and security needs for various companies and how Vanta is keeping companies in compliance. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJul 2, 2021 · 50 min
Text Blaze: Text Shortcuts with Scott Fortmann-Roe
There are over 4 billion people using email. Many people using email for business communicate quick questions to colleagues, send repetitive, template-based information to potential customers and freshly hired employees, and repeat a lot of the same phrases. We actually repeat phrases in a lot of written formats. How often do you copy and paste the same thing to multiple people? The company Text Blaze is making the workday a little faster, more productive, and convenient with their shortcut-to-snippet software product. With Text Blaze you can save any snippet of text or template, including templates that need fill-in-the-blank sections, to a keyboard shortcut. Then type that shortcut in Gmail, Google Docs, LinkedIn, or Salesforce, and wherever else you need to use your saved snippet. In this episode we talk to Scott Fortmann-Roe, CTO at Text Blaze. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJul 2, 2021 · 47 min
LayerCI with Colin Chartier
Continuous integration is a coding practice where engineers deliver incremental and frequent code changes to create higher quality software and collaborate more. Teams attempting to continuously integrate new code need a consistent and automated pipeline for reviewing, testing, and deploying the changes. Otherwise change requests pile up in the queue and nothing gets integrated efficiently. The company LayerCI is a platform built to deliver a better remote infrastructure experience. It enables engineers to preview full stack staging environments for every commit and have a centralized CI/CD stack with full end-to-end testing. LayerCI can duplicate a fully provisioned environment so that end-to-end workflows can run in parallel and alongside unit tests. The result is faster code review, testing and deployment. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJul 1, 2021 · 54 min
Meltano: ELT for DataOps with Douwe Maan
ELT is a process for copying data from a source system into a target system. It stands for “Extract, Load, Transform” and starts with extracting a copy of data from the source location. It’s loaded into the target system like a data warehouse, and then it’s ready to be transformed into a usable format for things like modern cloud applications. The company Meltano provides code that manages ELT pipelines through an open-source, self-hosted, CLI-first, debuggable, and extensible process. Meltano projects manage your Singer tap and target configurations to easily select which entities and attributes to extract. These pipelines track their own incremental replication state so they can pick up where the previous run left off. Once your raw data is in its target source, Meltano helps you transform it into a usable format. These pipelines can run on a schedule and be fed to supported orchestrators like Apache Airflow. In this episode we talk to Douwe Maan, founder and CEO of Meltano, about their product-market fit and delivery plans. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 29, 2021 · 1 hr 20 min
Magic with Sean Li
In this episode we discuss plug and play auth, password management, and crypto with Sean Li, co-founder and CEO of Magic. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 28, 2021 · 1 hr
Timescale: Time Series Databases with Mike Freedman
For some data problems, you may be more concerned with the state of data at a particular point. A ticket is booked, or it’s not. How many poetry submissions were made to the contest? This is relational data. For other problems, you’re concerned with the change in data over time. Solar energy consumption, for example, or price behavior. This is time-series data. TimescaleDB resembles a traditional postgreSQL database, but is supercharged for time-series data. TimescaleDB has queries that are 10x faster, is optimized for time-series and advanced time-series analytics, has automated continuous aggregations, columnar storage, and uses best-in-class algorithms and memory efficient structures to compress your data so you can store more at a much cheaper price. And for your questions that are not time-series dependent, TimescaleDB is still an efficient and cost effective relational database. In this episode we talk to Mike Freedman, Co-Founder and CTO of TimescaleDB. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 25, 2021 · 49 min
Cloud Cost with Martin Casado
The cloud has delivered amazing benefits like on-demand infrastructure that’s easy to use, pay-as-you-go subscription plans, and effortless scaling of applications. This flexibility minimizes the growing pains for businesses and explains why today’s startups and established companies are both building apps on the cloud. However, the costs of using the cloud stack up once companies reach large scale. Dropbox, for example, shifted away from the cloud in 2016 to opt for a custom built infrastructure in co-location facilities. They saved $75 million over 2 years and increased their gross margins from 33% to 67% due to this change. Actually, recent research suggests major companies spend 75%-80% of cost of revenue on their cloud bills. Should large companies shift away from the cloud like Dropbox did? Is it too late for some companies to untangle themselves from it? In this episode we talk with Martin Casado, Partner at Andreessen Horowitz and an expert in IT Infrastructure. We discuss the costs of cloud for small and large companies, and the financial implications of cloud infrastructure at scale. Show Notes Martin Casado's article on cloud costs Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 24, 2021 · 54 min
Uber Data Science with Kevin Novak
Uber is one of many examples we’ve discussed on this show that has changed the world with big data analysis. With over 8 million users, 1 billion Uber trips and people driving for Uber in over 400 cities and 66 countries, Uber has redefined an entire industry in a very short time frame. It’s difficult to find precise details about Uber’s big data infrastructure online, but we know they collect every possible data point about their drivers and riders. Matching riders and drivers, setting ride fares, predicting demand for cars - these are some examples of what Uber does with its data. In this episode we talk with Kevin Novak about Uber’s data science. What are some key details about their data infrastructure? What can people expect in the future from their data methodologies? How did a tech conference in Paris turn into one of the fastest growing, highest valued startups in the world? Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 23, 2021 · 42 min
Axiom Browser Automation with Yaseer Sheriff
The quantity and quality of a company’s data can mean the difference between a major success or major failure. Companies like Google have used big data from its earliest days to steer their product suite in the direction consumers need. Other companies, like Apple, didn’t always use big data analytics to drive product design, but they do now. The company Axiom has created a large suite of advanced browser robots that perform difficult tasks like consolidating data across many web applications, extracting data from public sites or from behind logins, data entry, user interface automation, file management and spreadsheet automation. These powerful tools enable people and businesses to collect valuable data to inform their decisions. In this episode we talk to Yaseer Sheriff, Co-Founder and CEO at Axiom. We discuss the value of big data, the opportunities their products enable, and how people can use their tools to improve their data collection practices. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 22, 2021 · 1 hr 36 min
Software Investing with David Rosenthal
In this episode we discuss software investing, business, and the future with David Rosenthal, co-host of the Acquired podcast. This interview was also recorded as our very first video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 21, 2021 · 57 min
Dark Forest: Transparency on Blockchains with Zero-Knowledge Proofs with Brian Gu
Complete information games are games where every player has information about the game sequence, strategies, and payoffs throughout gameplay. Playing chess, for example, relies on knowing the location of every piece everywhere on the board. In an incomplete information game like Minecraft, you continually gain new information during gameplay. Until very recently, incomplete information was nearly impossible on blockchains because every transaction and party is public. However, applied zero-knowledge cryptography on Ethereum has advanced greatly the past 18 months and is changing the transparency of blockchains. In this episode we talk to Brian Gu, a creator of the new game Dark Forest. Dark Forest is a space-conquest game built on Ethereum where players discover and conquer planets in an infinite, procedurally-generated, cryptographically-specified universe. It uses zero-knowledge proofs to validate game moves on Ethereum without sharing information to other players about the moves. We discuss the technology behind Dark Forest and the possibilities of a potentially less transparent blockchain future. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 18, 2021 · 53 min
Spacemesh: A New Consensus Protocol Anton Learner
Proof of Work cryptocurrency mining, as used on the Ethereum and Bitcoin blockchains, requires huge amounts of energy to validate transactions and generate new tokens. The alternative, Proof of Stake, needs large deposits of assets to be staked up front in order to work. While both consensus protocols have their own drawbacks, they are the current industry standards. The company Spacemesh developed a new consensus protocol with the goal of powering an energy-efficient, decentralized, secure, and scalable smart contracts global computer and a cryptocurrency in the permissionless settings. They call their protocol Proof of Space Time which works on a blockmesh structure rather than a blockchain. The Spacemesh protocol allows newcomers to contribute to the security of the cryptocurrency network via unused storage space on their hard drives, driving down energy consumption and enabling anyone with a computer to contribute. In this episode we talk to Anton Learner, Core Team Lead at Spacemesh. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 17, 2021 · 54 min
StreamSets: DataOps and Smart Pipelines with Arvind Prabhakar
The company StreamSets is enabling DataOps practices in today’s enterprises. StreamSets is a data engineering platform designed to help engineers design, deploy, and operate smart data pipelines. StreamSets Data Collector is a codeless solution for designing pipelines, triggering CDC operations, and monitoring data in flight. StreamSets Transformer uses Apache Spark to generate insights about your data across multiple different platforms. Their Control Hub is the single hub for managing all of your data pipelines, data processing jobs, and execution engines. In this episode we talk to Arvind Prabhakar, CTO at StreamSets. Arvind is also an Official Member of the Forbes Technology Council, and a Member, PMC Chair/Member, Committer, Mentor, and Contributor to multiple projects with the Apache Software Foundation. He was previously a Director of Engineering at Cloudera, and a Software Architect at Informatica before that. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 16, 2021 · 53 min
Blissfully: Comprehensive IT Management with Aaron White
Delivering Saas products involves a lot more than just building the product. Saas management involves customer relationship management, licensing, renewals, maintaining software visibility, and the general management of the technology portfolio. The company Blissfully helps businesses manage their SaaS products from within a complete IT platform with organization, automation, and security built in. The Blissfully platform offers a system of record for creating and maintaining a single source of truth for technology, a workflows and automations feature for defining and executing consistent IT processes, an IT collaboration feature, and a security and compliance feature. These features come together to form a comprehensive IT management platform. In this episode we talk with Aaron White, a Founder and CTO at Blissfully. Aaron was previously a Co-Founder and Board Member of Price Intelligently, and Vice President at Venrock before that. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 15, 2021 · 45 min
Stemma: Understanding Big Data with Mark Grover
Amundsen was started at Lyft and is the leading open-source data catalog with the fastest-growing community and the most integrations. Amundsen enables you to search your entire organization by text search, see automated and curated metadata, share context with co workers, and learn from others by seeing most common queries on a table or frequently used data. Powered by Amundsen, the company Stemma is a fully managed data catalog that bridges the gap between data producers and data consumers. Stemma adds features to Amundsen like showing meaningful data to individual users, adding metadata to data automatically, and documenting data on the fly. Stemma integrates with all the major data sources like Snowflake, Redshift, Google BigQuery, and Apache Airflow. In this episode we talk to Mark Grover, Founder at Stemma. Mark co-created Amundsen and authored the book Hadoop Application Architectures. He was an engineer at Cloudera before joining Lyft as a Product Manager. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 14, 2021 · 54 min
Coinbase React Native: Building the Cryptocurrency Ecosystem with Brent Walter and Jacob Thornton
Coinbase is a very popular and well trusted cryptocurrency platform for buying and selling digital assets like Bitcoin, Ethereum, and many more. With Coinbase you can manage your portfolio of cryptocurrencies in 1 place like you would for other investments. There are added features like scheduling recurring purchases of assets, time-delayed withdrawals from digital vaults, and mobile apps with sleek UIs for mobile access to the markets. Coinbase has gained trust as a platform for storing digital assets in secure offline storage, using servers covered by insurance policies, by following industry best practices and supporting a variety of the most popular digital currencies. In this episode we talk to Brent Walter, a Senior Engineering Manager at Coinbase. Brent was previously an Advisor at With Labs and various other companies, and was a Director of Software Engineering at Western Digital before that. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
- SEJun 11, 2021 · 48 min
Oracle Cloud with Salman Paracha
Corey Quinn is guest hosting on Software Engineering Daily this week, presenting a Tour of the Cloud. Corey Quinn is the Chief Cloud Economist at The Duckbill Group, where he helps companies fix their AWS bill by making it smaller and less horrifying. If you're looking to lower your AWS bill or negotiate a new contract with AWS, you can learn more about The Duckbill Group's services at https://www.duckbillgroup.com/. Corey is also the host and creator of Last Week in AWS, which publishes newsletters and podcasts covering topics to help you stay up to date on all things AWS and insightful conversations with experts in the world of cloud computing all delivered lovingly with Corey's infamous snark. Subscribe at https://www.lastweekinaws.com and follow Corey on Twitter @QuinnyPig. In this episode, Corey Quinn interviews Salman Paracha, Group Vice President, Cloud Engineering at Oracle.
- SEJun 10, 2021 · 53 min
Digital Ocean with John Allspaw
Corey Quinn is guest hosting on Software Engineering Daily this week, presenting a Tour of the Cloud. Corey Quinn is the Chief Cloud Economist at The Duckbill Group, where he helps companies fix their AWS bill by making it smaller and less horrifying. If you're looking to lower your AWS bill or negotiate a new contract with AWS, you can learn more about The Duckbill Group's services at https://www.duckbillgroup.com/. Corey is also the host and creator of Last Week in AWS, which publishes newsletters and podcasts covering topics to help you stay up to date on all things AWS and insightful conversations with experts in the world of cloud computing all delivered lovingly with Corey's infamous snark. Subscribe at https://www.lastweekinaws.com and follow Corey on Twitter @QuinnyPig. In this episode, Corey Quinn interviews John Allspaw, Founder and Principal of Adaptive Capacity Labs.