Keeping analysis pipelines reproducible
Pinning tool versions, recording parameters next to results and keeping raw data read-only solves most of the "it worked last month" problems. Containers help, but the habits matter more.
Occasional writing on data, code and the tools in between.
Pinning tool versions, recording parameters next to results and keeping raw data read-only solves most of the "it worked last month" problems. Containers help, but the habits matter more.
Streaming beats loading. A small buffered reader and a clear idea of which columns you actually need will usually outperform a clever library that parses everything up front.
Update packages, disable password logins, set up automatic security updates, and write down what you installed and why. Future you will be grateful.