datatools

Command line utilities for simplifying work with CSV, JSON, Excel Workbooks and plain text files or content and general purpose shell scripting.

• csv2json - a tool to take a CSV file and convert it into a JSON blob array or a list of JSON blobs one per line
• csv2mdtable - a tool to render CSV as a Github Flavored Markdown table
• csv2xlsx - a tool to take a CSV file and add it as a sheet to a Excel Workbook file.
• csvcols - a tool for formatting command line arguments into CSV row of columns or filtering CSV rows for specific columns
• csvfind - a tool for filtering a CSV file by column’s value
• csvjoin - a tool to join to CSV files on common values in designated columns, writes combined CSV rows to stdout
• csvrows - a tool for formatting command line arguments into CSV columns of rows or filtering CSV columns for specific rows
• jsoncols - a tool for exploring and extracting JSON values into columns
• jsonjoin - a tool for joining JSON object documents
• jsonmunge - a tool to transform JSON documents into something else
• jsonrange - a tool for iterating for JSON maps and arrays
• vcard2json - an experimental tool to convert vCards to JSON
• xlsx2csv - a tool for converting Excel Workbooks sheets to a CSV file(s)
• xlsx2json - a tool for converting Excel Workbooks to JSON files

Compiled versions are provided for Linux (amd64), Mac OS X (amd64), Windows 10 (amd64) and Raspbian (ARM7). See https://github.com/caltechlibrary/datatools/releases.

Use the utilities try “-help” option for a full list of options.

For scripting

Various utilities for simplifying work on the command line.

• findfile - find files based on prefix, suffix or contained string
• finddir - find directories based on prefix, suffix or contained string
• mergepath - prefix, append, clip path variables
• range - emit a range of integers (useful for numbered loops in Bash)
• reldate - display a relative date in YYYY-MM-DD format
• timefmt - format a time value based on Golang’s time format language
• urlparse - split a URL into parts

Compiled versions are provided for Linux (amd64), Mac OS X (amd64), Windows 10 (amd64) and Raspbian (ARM7). See https://github.com/caltechlibrary/datatools/releases.

Use the utilities try “-help” option for a full list of options.

Installation

datatools is go get-able.

    go get github.com/caltechlibrary/datatools/...

Or see INSTALL.md for details for installing compiled versions of the programs.