Database Reference
In-Depth Information
frankly, the computer, let alone the command line, is of very little use here. We have,
however, provided some pointers for further reading on this topic.
In the three intermezzo chapters, we looked at some broader topics of doing data sci‐
ence at the command line, topics which are not really specific to one particular step.
In
Chapter 4
, we explained how you can turn one-liners and existing code into reusa‐
ble command-line tools. In
Chapter 6
, we described how you can manage your data
workflow using a command-line tool called Drake. In
Chapter 8
, we demonstrated
how ordinary command-line tools and pipelines can be run in parallel using GNU
Parallel. These topics can be applied at any point in your data workflow.
It is impossible to demonstrate all command-line tools that are available and relevant
for doing data science. New command-line tools are created on a daily basis. As you
may have come to understand by now, this topic is more about the idea of using the
command line, rather than giving you an exhaustive list of tools.
Three Pieces of Advice
You probably spent quite some time reading these chapters and perhaps also follow‐
ing along with the code examples. In the hope that it maximizes the return on this
investment and increases the probability that you'll continue to incorporate the com‐
mand line into your data science workflow, we would like to offer you three pieces of
advice: (1) be patient, (2) be creative, and (3) be practical. In the next three subsec‐
tions we elaborate on each piece of advice.
Be Patient
The first piece of advice that we can give is to be patient. Working with data on the
command line is different from using a programming language, and therefore it
requires a different mindset.
Moreover, the command-line tools themselves are not without their quirks and
inconsistencies. This is partly because they have been developed by many different
people, over the course of multiple decades. If you ever find yourself at a loss regard‐
ing their mind-dazzling options, don't forget to use
--help
,
man
, or your favorite
search engine to learn more.
Still, especially in the beginning, it can be a frustrating experience. Trust us, you will
become more proficient as you practice using the command line and its tools. The
command line has been around for many decades, and will be around for many more
to come. It is a worthwhile investment.
