Articles related to Rust from the team that helps B2C companies build and defend revenue with AI.
Here are Faraday's contributions to open source that we use every day in production. (beta release) 3rd gen batch processing on k8s: falconeri falconeri is a distributed batch job runner for kubernetes (k8s). It is compatible with Pachyderm pipeline definitions, but is simpler and handles autoscaling, etc. properly. (beta release)
Read more
This post is part of our practical cartography and data science series. The problem: you want to split up a few million U.S. address records into equally-sized chunks that retain spatial hierarchy. You want to do this without anything other than a street address (geocoding is expensive!). Maybe you
Read moreThis is part of our series on data science because it belongs in your toolchain. Happy Null Removal! The latest version of scrubcsv has built-in null value removal: $ cat a.csv name,breed,age jerry,beagle,n/a tater,null,1 $ scrubcsv -n 'null|n/a' a.csv name,breed,
Read more
This post is part of our data science hacks series At Faraday, we've long used csvkit to understand, transform, and beat senseless our many streams of data. However, even this inimitable swiss army knife can be improved on - we've switched to xsv. xsv is a fast CSV-parsing toolkit written
Read moreThis is part of our series on things that are obvious once you see them - and our data science series because it belongs in your toolchain. Lies, damn lies, and commercial CSV export modules. Who wrote these things? On what planet would this be acceptable? Whatever. Name,What's wrong
Read moreYesterday morning, I was confronted with a truly terrible error message from a Rust program I was developing: $ cage up --init ... Error: error getting the project's state from Docker ExpectedError("Object", "null") The first part of that error message comes from cage (our open source tool
Read moreThis post is part of our rust series. The Rust compiler just saved me from a nasty threading bug. I was working on cage (our open source development tool for Docker apps with lots of microservices), and I decided to parallelize the routine that transformed docker-compose.yml files. This was
Read more
This post is part of our devops series. At Faraday, we rely heavily on microservices to analyze data, generate maps and make predictions. All our microservices run inside Docker containers, which makes it easy to run our code either locally or in the cloud. But if you've ever worked on
Read moreDo you maintain a project written in Rust? Would you like to enable really aggressive warnings to make code review easier? Here's what it looks like: We can set this up using a combination of Rust's built-in warnings and the excellent Clippy package. For best results with Clippy, it's easiest
Read more