Friday, 5 December 2014

UNIX Commands


Command
Description
•
apropos word
Show commands pertinent to word. See also threadsafe

which command
Show full path name of command

time command
See how long a command takes
•
time cat
Start stopwatch. Ctrl-d to stop. See also sw
•
nice info
Run a low priority command (info in this case)
•
renice 19 -p $$
Make shell (script) low priority. Use for non interactive tasks
•
look prefix
Quickly search (sorted) dictionary
•
grep --color expr...ion /usr/share/dict/words
Highlight occurrences of regular expression in dictionary

gpg -c file
Encrypt file

gpg file.gpg
Decrypt file
•
alias hd='od -Ax -tx1z -v'
Handy hexdump. (usage e.g.: • hd /proc/self/cmdline | less)
•
alias realpath='readlink -f'
Canonicalize path. (usage e.g.: • realpath ~/../$USER)
•
set | grep $USER
Search current environment
•
ls /usr/bin | pr -T9 -W$COLUMNS
Print in 9 columns to width of terminal

touch -c -t 0304050607 file
Set file timestamp (YYMMDDhhmm)
dir navigation
•
cd -
Go to previous directory
•
cd
Go to home directory

(cd dir && command)
Go to dir, execute command and return to current dir
•
pushd .
Put current dir on stack so you can popd back to it
CDs

gzip < /dev/cdrom > cdrom.iso.gz
Save copy of data cdrom

mkisofs -V NAME -r dir | gzip > cdrom.iso.gz
Create cdrom image from contents of dir

mount -o loop cdrom.iso /mnt/dir
Mount the cdrom image at /mnt/dir (read only)

cdrecord -v dev=/dev/cdrom blank=fast
Clear a CDRW

gzip -dc cdrom.iso.gz | cdrecord -v dev=/dev/cdrom -
Burn cdrom image (use dev=ATAPI -scanbus to confirm dev)

cdparanoia -B
Rip audio tracks from CD to wav files in current dir

cdrecord -v dev=/dev/cdrom -audio *.wav
Make audio CD from all wavs in current dir (see also cdrdao)

oggenc --tracknum='track' track.cdda.wav -o 'track.ogg'
Make ogg file from wav file
archives

tar c dir/ | bzip2 > dir.tar.bz2
Make archive of dir/

bzip2 -dc dir.tar.bz2 | tar x
Extract archive (use gzip instead of bzip2 for tar.gz files)

tar c dir/ | gzip | gpg -c | ssh user@remote 'dd of=dir.tar.gz.gpg'
Make encrypted archive of dir/ on remote machine

find dir/ -name '*.txt' | tar c --files-from=- | bzip2 > dir_txt.tar.bz2
Make archive of subset of dir/ and below

find dir/ -name '*.txt' | xargs cp -a --target-directory=dir_txt/ --parents
Make copy of subset of dir/ and below

( tar c /dir/to/copy ) | ( cd /where/to/ && tar x -p )
Copy (with permissions) copy/ dir to /where/to/ dir

( cd /dir/to/copy && tar c . ) | ( cd /where/to/ && tar x -p )
Copy (with permissions) contents of copy/ dir to /where/to/

( tar c /dir/to/copy ) | ssh -C user@remote 'cd /where/to/ && tar x -p'
Copy (with permissions) copy/ dir to remote:/where/to/ dir

dd bs=1M if=/dev/hda | gzip | ssh user@remote 'dd of=hda.gz'
Backup harddisk to remote machine
rsync (Use the --dry-run option for testing)

rsync -P rsync://rsync.server.com/path/to/file file
Only get diffs. Do multiple times for troublesome downloads

rsync --bwlimit=1000 fromfile tofile
Locally copy with rate limit. It's like nice for I/O

rsync -az -e ssh --delete ~/public_html/ remote.com:'~/public_html'
Mirror web site (using compression and encryption)

rsync -auz -e ssh remote:/dir/ . && rsync -auz -e ssh . remote:/dir/
Synchronize current directory with remote one
file searching
•
alias l='ls -l --color=auto'
quick dir listing
•
ls -lrt
List files by date. See also newest

find -name '*.[ch]' | xargs grep -E 'expr'
Search 'expr' in this dir and below. See also findrepo

find -type f -print0 | xargs -r0 grep -F 'string'
Search all regular files for 'string' in this dir and below

find -maxdepth 1 -type f | xargs grep -F 'string'
Search all regular files for 'string' in this dir

find -maxdepth 1 -type d | while read dir; do echo $dir; echo cmd2; done
Process each item with multiple commands (in while loop)
•
find -type f ! -perm -444
Find files not readable by all (useful for web site)
•
find -type d ! -perm -111
Find dirs not accessible by all (useful for web site)
•
locate -r 'file[^/]*\.txt'
Search cached index for names. This re is like glob *file*.txt
networking (Note ifconfig, route, mii-tool, nslookup commands are obsolete)
•
ip link show
List interfaces

ethtool interface
List interface status

ip link set dev eth0 name wan
Rename eth0 to wan

ip addr add 1.2.3.4/24 brd + dev eth0
Add ip and mask(255.255.255.0)

ip link set dev interface up
Bring interface up (or down)

ip route add default via 1.2.3.254
Set default gateway to 1.2.3.254
•
tc qdisc add dev lo root handle 1:0 netem delay 20msec
Add 20ms latency to loopback device (for testing)
•
tc qdisc del dev lo root
Remove latency added above
•
host pixelbeat.org
Lookup ip address for name or vice versa
•
hostname -i
Lookup local ip address (equivalent to host `hostname`)
•
netstat -tupl
List internet services on a system
•
netstat -tup
List active connections to/from system
wget (multi purpose download tool)
•
(cd cmdline && wget -nd -pHEKk http://www.pixelbeat.org/cmdline.html)
Store local browsable version of a page to the current dir

wget -c http://www.example.com/large.file
Continue downloading a partially downloaded file

wget -r -nd -np -l1 -A '*.jpg' http://www.example.com/
Download a set of files to the current directory

wget ftp://remote/file[1-9].iso/
FTP supports globbing directly
•
wget -q -O- http://www.pixelbeat.org/timeline.html | grep 'a href' | head
Process output directly

echo 'wget url' | at 01:00
Download url at 1AM to current dir

wget --limit-rate=20k url
Do a low priority download (limit to 20KB/s in this case)

wget -nv --spider --force-html -i bookmarks.html
Check links in a file

wget --mirror http://www.example.com/
Efficiently update a local copy of a site (handy from cron)
windows (note samba is the package that provides all this windows specific networking support)
•
smbtree
Find windows machines. See also findsmb

nmblookup -A 1.2.3.4
Find the windows (netbios) name associated with ip address

smbclient -L windows_box
List shares on windows machine or samba server

mount -t smbfs -o fmask=666,guest //windows_box/share /mnt/share
Mount a windows share

echo 'message' | smbclient -M windows_box
Send popup to windows machine (off by default in XP sp2)
math
•
echo '(1 + sqrt(5))/2' | bc -l
Quick math (Calculate φ). See also bc
•
echo 'obase=16; ibase=10; 123' | bc
Base conversion (decimal to hexadecimal)
•
echo $((0x2dec))
Base conversion (hex to dec) ((shell arithmetic expansion))
•
echo 'pad=20; min=64; (100*10^6)/((pad+min)*8)' | bc
More complex (int) e.g. This shows max FastE packet rate
•
echo 'pad=20; min=64; print (100E6)/((pad+min)*8)' | python
Python handles scientific notation
•
echo 'pad=20; plot [64:1518] (100*10**6)/((pad+x)*8)' | gnuplot -persist
Plot FastE packet rate vs packet size
•
seq 100 | (tr '\n' +; echo 0) | bc
Add a column of numbers. See also add and funcpy
text manipulation (note sed uses stdin and stdout, so if you want to edit files, append <oldfile >newfile)

sed 's/string1/string2/g'
Replace string1 with string2

sed 's/\(.*\)1/\12/g'
Modify anystring1 to anystring2

sed '/ *#/d; /^ *$/d'
Remove comments and blank lines

sed ':a; /\\$/N; s/\\\n//; ta'
Concatenate lines with trailing \

sed 's/[ \t]*$//'
Remove trailing spaces from lines

sed 's/\([\\`\\"$\\\\]\)/\\\1/g'
Escape shell metacharacters active within double quotes

sed -n '1000p;1000q'
Print 1000th line

sed -n '10,20p;20q'
Print lines 10 to 20

sed -n 's/.*<[tT][iI][tT][lL][eE]>\(.*\)<\/[tT][iI][tT][lL][eE]>.*/\1/p;T;q'
Extract title from HTML web page.

sort -t. -k1,1n -k2,2n -k3,3n -k4,4n
Sort IPV4 ip addresses
•
echo 'Test' | tr '[:lower:]' '[:upper:]'
Case conversion
•
tr -dc '[:print:]' < /dev/urandom
Filter non printable characters
•
grep 'processor' /proc/cpuinfo | wc -l
Count lines
set operations (Note LANG=C is for speed) (Note also these assume no duplicate lines within a file)

LANG=C sort file1 file2 | uniq
Union of unsorted files

LANG=C sort file1 file2 | uniq -d
Intersection of unsorted files

LANG=C sort file1 file1 file2 | uniq -u
Difference of unsorted files

LANG=C sort file1 file2 | uniq -u
Symmetric Difference of unsorted files

LANG=C comm file1 file2 | sed 's/^\t*//'
Union of sorted files

LANG=C comm -12 file1 file2
Intersection of sorted files

LANG=C comm -13 file1 file2
Difference of sorted files

LANG=C comm -3 file1 file2 | sed 's/^\t*//'
Symmetric Difference of sorted files
calendar
•
cal -3
Display a calendar
•
cal 9 1752
Display a calendar for a particular month year
•
date -d fri
What date is it this friday. See also day
•
date --date='25 Dec' +%A
What day does xmas fall on, this year
•
date --date '1970-01-01 UTC 1234567890 seconds'
Convert number of seconds since the epoch to a date
•
TZ=':America/Los_Angeles' date
What time is it on West coast of US (use tzselect to find TZ)

echo "mail -s 'get the train' P@draigBrady.com < /dev/null" | at 17:45
Email reminder
•
echo "DISPLAY=$DISPLAY xmessage cooker" | at "NOW + 30 minutes"
Popup reminder
locales
•
printf "%'d\n" 1234
Print number with thousands grouping appropriate to locale
•
BLOCK_SIZE=\'1 ls -l
get ls to do thousands grouping appropriate to locale
•
echo "I live in `locale territory`"
Extract info from locale database
•
locale | cut -d= -f1 | xargs locale -kc | less
List fields in locale database
•
LANG=en_IE.utf8 locale int_prefix
Lookup locale info for specific country. See also ccodes
disk space (See also FSlint)
•
ls -lSr
Show files, biggest last
•
du -s * | sort -k1,1rn | head
Show top disk users in current dir. See also dutop
•
df -h
Show free disk space
•
df -i
Show free inodes
•
fdisk -l
Show disks partitions sizes and types (run as root)
•
rpm -q -a --qf '%10{SIZE}\t%{NAME}\n' | sort -k1,1n
List all packages by installed size (Bytes) on rpm distros
•
dpkg-query -W -f='${Installed-Size;10}\t${Package}\n' | sort -k1,1n
List all packages by installed size (KBytes) on deb distros
•
dd bs=1 seek=2TB if=/dev/null of=ext3.test
Create a large test file (taking no space). See also truncate
monitoring/debugging
•
strace -c ls >/dev/null
Summarise/profile system calls made by command
•
strace -f -e open ls >/dev/null
List system calls made by command
•
ltrace -f -e getenv ls >/dev/null
List library calls made by command
•
lsof -p $$
List paths that process id has open
•
lsof ~
List processes that have specified path open
•
tcpdump not port 22
Show network traffic except ssh. See also tcpdump_not_me
•
ps -e -o pid,args --forest
List processes in a hierarchy
•
ps -e -o pcpu,cpu,nice,state,cputime,args --sort pcpu | sed '/^ 0.0 /d'
List processes by % cpu usage
•
ps -e -orss=,args= | sort -b -k1,1n | pr -TW$COLUMNS
List processes by mem usage. See also ps_mem.py
•
ps -C firefox-bin -L -o pid,tid,pcpu,state
List all threads for a particular process
•
ps -p 1,2
List info for particular process IDs
•
last reboot
Show system reboot history.
•
free -m
Show amount of (remaining) RAM (-m displays in MB)
•
watch -n1 'cat /proc/interrupts'
Watch changeable data continuously
System information (see also sysinfo)

hdparm -i /dev/hda
Show info about disk hda

hdparm -tT /dev/hda
Do a read speed test on disk hda

badblocks -s /dev/hda
Test for unreadable blocks on disk hda
•
mount | column -t
Show mounted filesystems on the system (and align output)
•
cat /proc/partitions
Show all partitions registered on the system
•
grep MemTotal /proc/meminfo
Show RAM total seen by the system
•
grep "model name" /proc/cpuinfo
Show CPU(s) info
•
lspci -tv
Show PCI info
•
lsusb -tv
Show USB info
recode (Obsoletes iconv, dos2unix, unix2dos)
•
recode -l | less
Show available conversions (aliases on each line)

recode windows-1252.. file_to_change.txt
Windows "ansi" to local charset (auto does CRLF conversion)

recode utf-8/CRLF.. file_to_change.txt
Windows utf8 to local charset

recode iso-8859-15..utf8 file_to_change.txt
Latin9 (western europe) to utf8

recode ../b64 < file.txt > file.b64
Base64 encode

recode /qp.. < file.txt > file.qp
Quoted printable decode

recode ..HTML < file.txt > file.html
Text to HTML
•
recode -lf windows-1252 | grep euro
•
echo -n 0x80 | recode latin-9/x1..dump
Show what a code represents in latin-9 charmap
•
echo -n 0x20AC | recode ucs-2/x2..latin-9/x
Show latin-9 encoding
•
echo -n 0x20AC | recode ucs-2/x2..utf-8/x
Show utf-8 encoding
interactive
•
Powerful filemanager that can browse rpm, tar, ftp, ssh, ...
•
Virtual terminals with detach capability, ...
•
links
Web browser
•
Interactive/scriptable graphing
•
octave
Matlab like environment



Key
Action
Notes
Ctrl+a c
new window

Ctrl+a n
next window
I bind F12 to this
Ctrl+a p
previous window
I bind F11 to this
Ctrl+a "
select window from list
I have window list in the status line
Ctrl+a Ctrl+a
previous window viewed




Ctrl+a S
split terminal horizontally into regions
Ctrl+a c to create new window there
Ctrl+a :resize
resize region

Ctrl+a :fit
fit screen size to new terminal size
Ctrl+a F is the same. Do after resizing xterm
Ctrl+a :remove
remove region
Ctrl+a X is the same
Ctrl+a tab
Move to next region




Ctrl+a d
detach screen from terminal
Start screen with -r option to reattach
Ctrl+a A
set window title

Ctrl+a x
lock session
Enter user password to unlock
Ctrl+a [
enter scrollback/copy mode
Enter to start and end copy region. Ctrl+a ] to leave this mode
Ctrl+a ]
paste buffer
Supports pasting between windows
Ctrl+a >
write paste buffer to file
useful for copying between screens
Ctrl+a <
read paste buffer from file
useful for pasting between screens



Ctrl+a ?
show key bindings/command names
Note unbound commands only in man page
Ctrl+a :
goto screen command prompt
up shows last command entered

Key
Action
Notes
Ctrl+o
toggle panes on/off

Ctrl+l
redraw screen
This is on all terminals
Ctrl+PgUp
goto parent dir

Ctrl+Enter
copy selected filename to command line
%f is equivalent
Ctrl+x+p
copy unselected panel's path to command line
%D is equivalent
Ctrl+x !
External panelize
Display paths returned from external command
Shift+mouse
select text

Insert
toggle selection of highlighted file

*
toggle selection

+
add pattern to selection

-
remove pattern from selection

F3
view

F4
edit

F5
copy

F6
rename

F7
mkdir

F8
remove

F9
menu

F10
Exit


No comments:

Post a Comment