Processing MySQL result in bash

Question

I\'m currently having a already a bash script with a few thousand lines which sends various queries MySQL to generate applicable output for munin.

Up until now the resul

Answer 1

You would use a while read loop to process the output of that command.

echo "SELECT id, name FROM type ORDER BY sort" | mysql test | while read -r line
do
    # you could use an if statement to skip the header line
    do_something "$line"
done

or store it in an array:

while read -r line
do
    array+=("$line")
done < <(echo "SELECT id, name FROM type ORDER BY sort" | mysql test)

That's a general overview of the technique. If you have more specific questions post them separately or if they're very simple post them in a comment or as an edit to your original question.

Answer 2

You're going to "fork out," as you put it, to the mysql command line client program anyhow. So either way you're going to have process-creation overhead. With your approach of using a new invocation of mysql for each query you're also going to incur the cost of connecting to and authenticating to the mysqld server multiple times. That's expensive, but the expense may not matter if this app doesn't scale up.

Making it secure against sql injection is another matter. If you prompt a user for her name and she answers "sally;drop table type;" she's laughing and you're screwed.

You might be wise to use a language that's more expressive in the areas that are important for data-base access for some of your logic. Ruby, PHP, PERL are all good choices. PERL happens to be tuned and designed to run snappily under shell script control.

Answer 3

My example is not Bash, but I'd like to point out my parameters at invoking the mysql command, they surpress the boxing and the headers.

#!/bin/sh

mysql dbname -B -N -s -e "SELECT * FROM tbl" | while read -r line
do
  echo "$line" | cut -f1   # outputs col #1
  echo "$line" | cut -f2   # outputs col #2
  echo "$line" | cut -f3   # outputs col #3
done