I fixed shell pipes (opens in new tab)

In a previous post I made pipes in unix shells more reliable. Well, it had some drawbacks. I’ll summarize the problem, the failed previous version, and then show the new and improved one. Problem summary Downstream processes in a unix shell pipe cannot know if the upstream finished successfully, or exited with an error. This means that it can’t know if it should “commit” the data it received. Example uses: $ pg_dumpall | xz -9 | google_cloud_storage_upload gs://bucket/path/postgres.dump $ gen...