How to filter files when using scp to copy dir recursively?

Question

I need to copy all the .class files from server to local with all dir reserved. e.g. server:/usr/some/unknown/number/of/sub/folders/me.class will be /usr/proj

Answer 1

1. Copy your source folder to somedir:

   cp -r srcdir somedir

2. Remove all unneeded files:

   find somedir -name '.svn' -exec rm -rf {} \+

3. launch scp from somedir

Answer 2

To exclude dotfiles in base directory:

scp -r [!.]* server:/path/to/something

[!.]* is a shell glob that expands to all files in working directory not starting with a dot.

Answer 3

I'd probably recommend using something like rsync for this due to its include and exclude flags, e.g:-

rsync -rav -e ssh --include '*/' --include='*.class' --exclude='*' \
server:/usr/some/unknown/number/of/sub/folders/ \ 
/usr/project/backup/some/unknown/number/of/sub/folders/

Some other useful flags:

• -r for recursive
• -a for archive (mostly all files)
• -v for verbose output
• -e to specify ssh instead of the default (which should be ssh, actually)

Answer 4

scp -i /home/<user>/.ssh/id_rsa -o "StrictHostKeyChecking=no" -rp /source/directory/path/[!.]* <target_user>@<target_system:/destination/directory/path

Answer 5

Below command for files.

scp `find . -maxdepth 1 -name "*.log" \! -name "hs_err_pid2801.log" -type f` root@IP:/tmp/test/

1. IP will be destination server IP address.
2. -name "*.log" for include files.
3. \! -name "hs_err_pid2801.log" for exclude files.
4. . is current working dir.
5. -type f for file type.

Below command for directory.

scp -r `find . -maxdepth 1 -name "lo*" \! -name "localhost" -type d` root@IP:/tmp/test/

you can customize above command as per your requirement.

Answer 6

There is no feature in scp to filter files. For "advanced" stuff like this, I recommend using rsync:

rsync -av --exclude '*.svn' user@server:/my/dir .

(this line copy rsync from distant folder to current one)

Recent versions of rsync tunnel over an ssh connection automatically by default.