NewsTech News

Software Engineering Daily

softwareengineeringdaily.com

Software Daily: The world through the lens of software.

Play

Open in

2,221 episodes
Avg 53 min
English

Episodes 2,221

Newest Oldest Longest

All20 Unplayed20 In progress0 Played0

Counted on this page — what you have heard stays on this device, so it is not something the list can be paged by.

Jun 9, 2021 · 53 min
GCP with Liz Fong-Jones
Corey Quinn is guest hosting on Software Engineering Daily this week, presenting a Tour of the Cloud. Corey Quinn is the Chief Cloud Economist at The Duckbill Group, where he helps companies fix their AWS bill by making it smaller and less horrifying. If you're looking to lower your AWS bill or negotiate a new contract with AWS, you can learn more about The Duckbill Group's services at https://www.duckbillgroup.com/. Corey is also the host and creator of Last Week in AWS, which publishes newsletters and podcasts covering topics to help you stay up to date on all things AWS and insightful conversations with experts in the world of cloud computing all delivered lovingly with Corey's infamous snark. Subscribe at https://www.lastweekinaws.com and follow Corey on Twitter @QuinnyPig. In this episode, Corey Quinn interviews Liz Fong-Jones, who is Principal Developer Advocate for SRE and Observability at Honeycomb and who worked at Google prior to that.
Jun 8, 2021 · 53 min
Azure with Troy Hunt
Corey Quinn is guest hosting on Software Engineering Daily this week, presenting a Tour of the Cloud. Corey Quinn is the Chief Cloud Economist at The Duckbill Group, where he helps companies fix their AWS bill by making it smaller and less horrifying. If you're looking to lower your AWS bill or negotiate a new contract with AWS, you can learn more about The Duckbill Group's services at https://www.duckbillgroup.com/. Corey is also the host and creator of Last Week in AWS, which publishes newsletters and podcasts covering topics to help you stay up to date on all things AWS and insightful conversations with experts in the world of cloud computing all delivered lovingly with Corey's infamous snark. Subscribe at https://www.lastweekinaws.com and follow Corey on Twitter @QuinnyPig. In this episode, Corey Quinn interviews Troy Hunt, who is a Microsoft Regional Director and MVP. Troy also runs "Have I Been Pwned" which checks to see if you have an email or password that has been compromised in a data breach.
Jun 7, 2021 · 54 min
AWS with Pete Cheslock
Corey Quinn is guest hosting on Software Engineering Daily this week, presenting a Tour of the Cloud. Corey Quinn is the Chief Cloud Economist at The Duckbill Group, where he helps companies fix their AWS bill by making it smaller and less horrifying. If you're looking to lower your AWS bill or negotiate a new contract with AWS, you can learn more about The Duckbill Group's services at https://www.duckbillgroup.com/. Corey is also the host and creator of Last Week in AWS, which publishes newsletters and podcasts covering topics to help you stay up to date on all things AWS and insightful conversations with experts in the world of cloud computing all delivered lovingly with Corey's infamous snark. Subscribe at https://www.lastweekinaws.com and follow Corey on Twitter @QuinnyPig. In this episode, Corey Quinn interviews Pete Cheslock, Chief Product Officer at Allma, about AWS. Prior to that Pete was Corey's colleague at The Duckbill Group.
Jun 4, 2021 · 55 min
Machine Learning: The Great Stagnation with Mark Saroufim
Mark Saroufim is the author of an article entitled “Machine Learning: The Great Stagnation”. Mark is a PyTorch Partner Engineer with Facebook AI. He has spent his entire career developing machine learning and artificial intelligence products. Before joining Facebook to do PyTorch engineering with external partners, Mark was a Machine Learning Engineer at Graphcore. Before that he founded Yuri.ai. Mark has also published “The Robot Overlord Manual” which “will teach you all the software, math and ML you’ll need to start building robots at home.” In this episode we discuss machine learning subjects and his experience developing cutting edge software. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Jun 3, 2021 · 1 hr 4 min
Special Edition Repeat: AWS Analysis with Corey Quinn
Next week Corey Quinn will be guest hosting on Software Engineering Daily, presenting a Tour of the Cloud. Corey Quinn is the Chief Cloud Economist at The Duckbill Group, where he helps companies fix their AWS bill by making it smaller and less horrifying. If you're looking to lower your AWS bill or negotiate a new contract with AWS, you can learn more about The Duckbill Group's services at https://www.duckbillgroup.com/. Corey is also the host and creator of Last Week in AWS, which publishes newsletters and podcasts covering topics to help you stay up to date on all things AWS and insightful conversations with experts in the world of cloud computing all delivered lovingly with Corey's infamous snark. Subscribe at https://www.lastweekinaws.com and follow Corey on Twitter @QuinnyPig. Amazon Web Services changed how software engineers work. Before AWS, it was common for startups to purchase their own physical servers. AWS made server resources as accessible as an API request, and has gone on to create higher-level abstractions for building applications. For the first few years of AWS, the abstractions were familiar. S3 provided distributed, reliable object storage. Elastic MapReduce provided a managed Hadoop system. Kinesis provided a scalable queue. Amazon provided developers with managed alternatives to complicated open source software. More recently, AWS has started to release products that are unlike anything else. A perfect example is AWS Lambda, the first function-as-a-service platform. Other newer AWS products include Ground Station, a service for processing satellite data and AWS DeepRacer, a miniature race car for developers to build and test machine learning algorithms on. As AWS has grown into new categories, the blog announcements of new services and features have started coming so frequently that it is hard to keep track of it all. Corey Quinn is the author of “Last Week in AWS”, a popular newsletter about what is changing across Amazon Web Services. Corey joins the show to give his perspective on the growing, shifting behemoth that is Amazon Web Services--as well as the other major cloud providers that have risen to prominence. He’s also the host of the Screaming in the Cloud podcast, which you should check out if you like this episode.
Jun 2, 2021 · 43 min
Polygon: Connecting Ethereum Compatible Blockchain Networks with Denis Ermolin
Platforms like Ethereum have billions of dollars of market cap and large developer communities. However, it is still a challenge to build widely adopted DApps on it because of current limitations. Blockchain Proof of Work transactions are typically slow, and Proof of Stake transactions trade off decentralization to achieve high throughput. Transaction fees get expensive, especially for high network load times, scalability is low and this creates a bad user experience. The company Polygon (previously Matic Network) solves some of these problems with their platform for Ethereum scaling and infrastructure development. Polygon combines the features of stand-alone blockchains (like sovereignty, scalability, and flexibility) and Ethereum (security, interoperability and developer experience). These features enable scalable solutions on Ethereum and support a multi-chain Ethereum ecosystem (polygon.technology). In this episode we talk to Denis Ermolin, a Senior Software Engineer at Polygon. Denis was previously a Senior Software Engineer at Animoca Brands, and CEO of Moonrealm Entertainment before that. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Jun 1, 2021 · 51 min
AWS Outpost Engineering with Joshua Burgin
AWS Outposts is a fully managed service that offers the same AWS infrastructure, AWS services, APIs, and tools to virtually any datacenter, co-location space, or on-premises facility for a truly consistent hybrid experience. AWS Outposts is ideal for workloads that require low latency access to on-premises systems, local data processing, data residency, and migration of applications with local system interdependencies (aws.amazon.com). In this episode we talk with Joshua Burgin, General Manager, AWS Outposts at Amazon Web Services. Joshua owns strategy, roadmaps, customer experience, pricing and demand generation for the AWS Edge/Hybrid Compute business, including full P&L responsibility. Joshua was previously a Senior Director, Technology Platform and Services at Zynga and a Senior Manager, Product Management at RPI before that. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 29, 2021 · 45 min
Flutter: Native Web and Mobile App Development with Allen Wyma
Flutter is a UI toolkit developed by Google that helps developers build natively compiled applications for mobile, web, desktop, and embedded devices from a single code base. Development is fast because the screen “hot reloads” as you develop, the architecture is layered for fast and expressive designs, and its widgets incorporate all critical platform differences such as scrolling, navigation, icons and fonts. In this episode we talk about developing Flutter apps with Allen Wyma. Allen is a Founder of Plangora, a web and mobile development company that specializes in PHP, iOS with Swift, android with Java, Wordpress, and Flutter. Allen is also an Elixir Mix Panelist at Devchat.tv where he interviews members of the Elixir community. We discuss Native app development and developing with Flutter. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 27, 2021 · 45 min
Data Exploration with a New Python Library with Doris Lee
Data exploration uses visual exploration to understand what is in a dataset and the characteristics of the data. Data scientists explore data to understand things like customer behavior and resource utilization. Some common programming languages used for data exploration are Python, R, and Matlab. Doris Jung-Lin Lee is currently a Graduate Research Assistant at the University of California, Berkeley, also earning a PhD in Information Management and Systems. Doris also did her undergrad at Berkeley, studying physics and astrophysics. She is currently developing Lux, a Python library for accelerating and simplifying the process of data exploration. Her research and work with Lux is aimed to make data science more intuitive and accessible to end users. In this episode Doris joins us to discuss data exploration and her research and development of Lux. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 27, 2021 · 1 hr
Data Management Systems and Artificial Intelligence with Arun Kumar
Arun Kumar is an Assistant Professor in the Department of Computer Science and Engineering and the Halicioglu Data Science Institute at the University of California, San Diego. His primary research interests are in data management and systems for machine learning/artificial intelligence-based data analytics. Systems and ideas based on his research have been released as part of the Apache MADlib open-source library, shipped as part of products from Cloudera, IBM, Oracle, and Pivotal, and used internally by Facebook, Google, LogicBlox, Microsoft, and other companies. Arun did his undergrad in Computer Science and Engineering at the Indian Institute of Technology, Madras, and then his MS and PhD in Computer Science at the University of Wisconsin-Madison, where his thesis research explores problems at the intersection of data management and machine learning, with a focus on problems related to usability, developability, performance, and scalability. In this episode he joins us to discuss data management systems and artificial intelligence. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 25, 2021 · 55 min
Firebolt: Data Warehouses with Eldad Farkash
Cloud data warehouses are databases hosted in cloud environments. They provide typical benefits of the cloud like flexible data access, scalability, and performance. The company Firebolt provides a cloud data warehouse built for modern data environments. It decouples storage and compute to operate on top of existing data lakes like S3. It computes orders of magnitude faster performance from gigabyte to petabyte scale by using a columnar data structure, vectorized processing, just-in-time query compilation, and continuously aggregated indexing. Firebolt scales with data lakes by processing queries across clusters of nodes in parallel, providing consistently fast processing and granular control over resources. In this episode we talk with Eldad Farkash, Co-Founder and CEO of Firebolt. Eldad was previously a Venture Partner at Angular Ventures and a Founder, CTO and Board Member at Sisense before that. We discuss big data, data warehouses, and the unique benefits offered by Firebolt. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 24, 2021 · 48 min
Portainer: Container Management with Neil Cresswell
Running applications in containerized environments involves regularly organizing, adding and replacing containers. This complex job may involve managing clusters of containers in different geographic locations with different configuration requirements. Platforms like Kubernetes are great for managing this complexity, but include steep learning curves to efficiently get anything off the ground. The company Portainer provides a universal container management tool that works with Kubernetes, Docker, Docker Swarm, and Azure ACI. It enables managing containers without knowing platform-specific code and best practices. Instead, deploying containerized applications is done through a simple Graphical User Interface. Once deployed, you can observe and monitor the apps and govern security settings all through Portainer. In this episode, we talk to Neil Cresswell, a Co-Founder at Portainer. Neil is also CEO and Founder of CloudInovasi, and was CEO at Emerging Technology Partners before that. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 20, 2021 · 51 min
Preset: Visualizing Big Data with Srini Kadamati
Apache Superset is an open-source, fast, lightweight and modern data exploration and visualization platform. It can connect to any SQL based data source through SQLAlchemy at petabyte scale. Its architecture is highly scalable and it ships with a wide array of visualizations. The company Preset provides a powerful, easy to use data exploration and visualization platform powered by Apache Superset. Preset enables team members with some to no programming experience to build interactive visualizations and dashboards with a no-code viz builder and SQL editor. It works directly on top of popular cloud data warehouses and leading data engines. Preset delivers all the data visualization power of Apache Superset through their complete, easy to consume, enterprise ready platform. In this episode we talk with Srini Kadamati, Senior Data Scientist / Developer advocate at Preset. Previously Srini worked as Head of Product at Dataquest.io and as a Data Scientist at Radius Intelligence before that. He is also a Committer to Apache Superset. We discuss data visualization, the power of big Data, and Preset. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 20, 2021 · 51 min
BaseTen: Creating Machine Learning APIs with Tuhin Srivastava and Amir Haghighat
Application Programming Interfaces (APIs) are interfaces that enable multiple software applications to send and retrieve data from one another. They are commonly used for retrieving, saving, editing, or deleting data from databases, transmitting data between apps, and embedding third-party services into apps. The company BaseTen helps companies build and deploy machine learning APIs and applications. Using pre-existing ML models, or choosing from BaseTen’s library of pretrained models, BaseTen helps you instantly deploy API endpoints powered by those models to use in your applications. These APIs easily scale and integrate with existing data sources. BaseTen’s serverless infrastructure enables chaining model outputs and pre- and post- processing code. They also use a drag-and-drop UI builder to create custom UI’s for the applications, all without learning React. In this episode, we talk with Tuhin Srivastava and Amir Haghighat, founders at BaseTen. Tuhin previously founded Shape, and also worked as a Data Scientist at Gumroad. We discuss machine learning API development, scaling ML-driven applications, and the capabilities of BaseTen’s technology. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 18, 2021 · 53 min
Skynet Labs: Decentralized Internet with Matthew Sevey
The company Skynet Labs provides an open protocol for hosting data and web applications on the decentralized web. Skynet allows for decentralized, censorship-resistant, highly redundant storage and applications that are available around the globe. Developers don’t pay for their application’s storage, can launch apps with access to a user’s data right away, are free from corporations pulling access to their resources, and can maintain failover sites for when their primary site goes down. For users, you take your data with you without any corporate oversight, support developers and content creators by simply accessing their work, experience a web free of targeted ads, and never have to put your privacy or security at risk. Skynet is built on top of the Sia blockchain network, which is open-source and guided by the Sia Foundation. In this episode we talk with Matthew Sevey, Engineering Engineer at Skynet Labs. Before joining Skynet, Matthew was a Project Manager at Procter and Gamble and a web development fellow at Startup Institute before that. We discuss decentralized internet, the Sia blockchain network, and Skynet’s mission to build a better and more equitable ecosystem. Sponsorship inquiries: sponsor@softwareengineeringdaily.com Show Notes: Skynet Website Skynet Jobs Skynet Discord Skynet Hackathon SkyChat SkyFeed
May 17, 2021 · 43 min
ClickHouse: Data Warehousing with Robert Hodges
Columnar databases store and retrieve columns of data rather than rows of data. Each block of data in a columnar database stores up to 3 times as many records as row-based storage. This means you can read data with a third of the power needed in row-based data, among other advantages. The company Altinity is the leading enterprise provider for ClickHouse - an open-source column-store analytic database, now a fully managed service developed and operated with Altinity.Cloud. Altinity only bills for the compute, storage, and support that is used. They provide enterprise support for analytic applications like tuning queries, Kafka support, and ClickHouse bugs, and their ClickHouse clusters run with out-of-the-box security and privacy. In this episode we talk with Robert Hodges, CEO at Altinity. Before becoming CEO at Altinity, Robert worked as a Senior Staff Engineer at VMWare and was the CEO of Continuent before that. We discuss databases and data warehousing, ClickHouse, and how Altinity helps customers create enterprise analytic applications. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 14, 2021 · 44 min
Data Mechanics: Data Engineering with Jean-Yves Stephan
Apache Spark is a popular open source analytics engine for large-scale data processing. Applications can be written in Java, Scala, Python, R, and SQL. These applications have flexible options to run on like Kubernetes or in the cloud. The company Data Mechanics is a cloud-native Spark platform for data engineers. It runs continuously optimized Apache Spark workloads on a managed Kubernetes cluster within the user’s cloud account. They boast a 50%-75% cost reduction from cloud providers by dynamically scaling applications based on load and automatically tuning app configurations based on the historical Spark pipeline runs. Their Kubernetes clusters are deployed within user accounts so user data never leaves the environment and they handle the cluster management. In this episode we talk to Jean-Yves Stephan, Co-Founder and CEO at Data Mechanics. Jean-Yves previously worked as a Software Engineer then a Tech Lead Manager at Databricks. We discuss big data engineering in Spark and the unique advantages of using Data Mechanics to make Spark development easier and more cost effective. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 13, 2021 · 49 min
Apache Hudi: Large Scale Data Systems with Vinoth Chandar
Apache Hudi is an open-source data management framework used to simplify incremental data processing and data pipeline development. This framework more efficiently manages business requirements like data lifecycle and improves data quality. Some common use cases for Hudi is record-level insert, update, and delete, simplified file management and near real-time data access, and simplified CDC data pipeline development (AWS.amazon.com). In this episode we speak to Vinoth Chandar, VP of Apache Hudi. Vinoth is the creator of the Hudi project at Uber. He continues to lead its evolution at the Apache Software Foundation. Previously he was a Principal Engineer at Confluent, and a Sr Staff Engineer/Manager at Uber before that. We discuss building large scale distributed and data systems. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 12, 2021 · 48 min
Akita: Application Programming Interfaces with Jean Yang
An application programming interface, API for short, is the connector between 2 applications. For example, a user interface that needs user data will call an endpoint, like a special URL, with request parameters and receive the data back if the request is valid. Modern applications rely on APIs to send data back and forth to each other and save, edit, delete, or retrieve data in databases. The number of APIs used in a single application is growing due to the increase of micro-services and distributed architectures. Understanding how your applications use APIs can increase their efficiency and stability and make debugging easier. The company Akita observes the structure of programs to visualize, map, and manage API behavior. By monitoring the APIs in your applications, Akita can catch code changes that may break production applications. While this work is normally labor-intensive, Akita automates it by analyzing the source code and logs. They check the observed behaviors against intended specs and contracts to provide clear oversight on all activity. This information can then be generated into maps that help you document and version your APIs across your entire service ecosystem. In this episode we talk with Jean Yang, Founder and CEO of Akita Software. Jean was previously an assistant professor at Carnegie Mellon University and a postdoctoral researcher and Harvard Medical School before that. We discuss modern APIs, their role in applications, and how Akita Software makes understanding and building APIs easier for developers. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
May 11, 2021 · 52 min
Nextmv: Optimization in Fluid Work Environments with Carolyn Mooney
The traveling salesman problem is a classic challenge of finding the shortest and most efficient route for a person to take given a list of destinations. This is one of many real-world optimization problems that companies encounter. How should they schedule product distribution, or promote product bundles, or define sales territories? The answers to these questions constantly change because business environments constantly change. The company Nextmv helps solve these problems with production-ready, commercial tools for solving optimization problems and simulating models with real company data. Their tool Hop encodes optimization strategies for dynamic environments. Hope can be deployed to routing, scheduling and assignment problems in multiple industries like on-demand delivery, e-commerce, and IT infrastructure management. Their tool Dash is a commercial-grade simulation engine that provides an environment to “A/B test” models online with real data. In this episode we talk to Carolyn Mooney, CEO at Nextmv. Carolyn was previously a Lead Systems Engineer at Grubhub, and a Decision System Analyst at Zoomer before that. We discuss optimization problems throughout different industries, machine learning strategies for solving them, and go into detail about how Nextmv helps companies become more profitable and efficient. Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Showing 721–740 of 2,221 episodes