Curs 7 Servicii de file sharing Gestiunea Serviciilor de Ret, ea 17 noiembrie 2011 GSR Curs 7, Servicii de file sharing 1/45 Moto Jesus saves! The rest of us better make backups. GSR Curs 7, Servicii de file sharing 2/45 Partajarea fis, ierelor SSH. rsync NFS Samba FTP ^Incheiere ^Intreb˘ari GSR Curs 7, Servicii de file sharing 3/45 Suport I \Unix and Linux System Administration" I Chapter 8 { Storage (Section \Storage area networking") I Chapter 18 { The Network File System I Chapter 30 { Cooperating with Windows (Section \Sharing files with Samba and CIFS") I \Professional Linux System Administration" I Chapter 12 { File and Print Sharing GSR Curs 7, Servicii de file sharing 4/45 Outline Partajarea fis, ierelor SSH. rsync NFS Samba FTP ^Incheiere ^Intreb˘ari GSR Curs 7, Servicii de file sharing 5/45 Partajarea fis, ierelor I file sharing I distribut, ie de cont, inut/date/informat, ie I probleme I drepturi de acces I autentificare I consum de resurse (l˘at, ime de band˘a) I interfat, ˘ade utilizare I scalabilitate { num˘arde utilizatori, num˘arde accese I HTTP/FTP, Peer-to-Peer, SSH, rsync, NFS, Samba GSR Curs 7, Servicii de file sharing 6/45 HTTP/FTP I HTTP I universal disponibil, num˘armare client, i (browsere) I suport de securitate (HTTPS) I num˘armare de aplicat, ii I nu are implicit suport pentru transferuri part, iale I wget --continue I folosit, ^ıngeneral pentru download; pentru upload se foloses, te SSH/FTP I necesit˘aacces s, i configur˘arila nivel de server I FTP I din ce ^ınce mai put, in utilizat I suport redus comparativ cu HTTP I suport de securitate: autentificare, FTPS I nu are suport implicit pentru transferuri part, iale I folosit pentru upload; un avantaj fat, ˘ade SSH este rapiditatea I posibile probleme de acces (active mode, passive mode) GSR Curs 7, Servicii de file sharing 7/45 WebDAV I web-based distributed authoring and versioning I \authoring" a activ, \versioning" mai t^arziu(extensia Delta-V) I \makes the web a readable and writable medium" I noi metode s, i headere ^ınHTTP I mod dav ^ınApache I ^ınLinux, davfs2, fusedav, cadaver (CLI) I util pentru sisteme de control al versiunii (Git, SVN): URL-uri read-write peste HTTP(S) I extensii: Delta-V, CalDAV, CardDAV, GroupDAV GSR Curs 7, Servicii de file sharing 8/45 Protocoale Peer-to-Peer I nu necesit˘aun server I upload/download facil I transfer part, ial I distribut, ie rapid˘a I scalabilitate I probleme cu NAT, firewall I utile pentru num˘armare de client, i/peeri I ^ıngeneral f˘ar˘aforme de securitate/drepturi de acces GSR Curs 7, Servicii de file sharing 9/45 SSH/rsync I SSH (scp) I transfer securizat (probabil cea mai sigur˘ametod˘a) I necesit˘acont s, i server I form˘apreferat˘ade upload I nu exist˘adownload public (anonim) I se prefer˘aHTTP sau protocoale peer-to-peer I f˘ar˘asuport de transfer part, ial (use rsync) I rsync I cel mai bun suport de transfer part, ial I actualiz˘ariale cont, inutului I se transfer˘adoar ce difer˘a(delta encoding) I util pentru mirroring s, i backup-uri I poate folosi wrapper cu SSH GSR Curs 7, Servicii de file sharing 10/45 NFS/Samba I NFS, SMB/CIFS, DFS, AFS I NFS (Network File System) I montare local˘a(mount -t nfs) I acces transparent I acces la server I configurare relativ facil˘a I suport de securitate I controlul accesului I sistem de fis, iere partajat I Samba I implementare a SMB/CIFS I compatibilitate cu sisteme Windows I acces la server I configurare complex˘a;se poate folosi SWAT I suport de securitate I montare local˘acu smbmount, smbfs GSR Curs 7, Servicii de file sharing 11/45 Outline Partajarea fis, ierelor SSH. rsync NFS Samba FTP ^Incheiere ^Intreb˘ari GSR Curs 7, Servicii de file sharing 12/45 scp { reminder I scp surs˘adestinat, ie I upload { folosit ^ın\colaborare" cu alte protocoale I scp file.txt [email protected]: I scp -r code/ [email protected]:public_html/ I download { folosit doar ^ın situat, iile ce necesit˘asecuritate; ^ın rest, HTTP I scp -r [email protected]:test-dir/ . GSR Curs 7, Servicii de file sharing 13/45 rsync I sincronizarea fis, ierelor ^ıntredou˘asisteme I minimizarea transferului I se transmit, ^ınm˘asuraposibilului, doar datele diferite I delta encoding I ^ınlocuitor pentru scp { sintax˘asimilar˘apentru client I Andrew Tridgell I backups I mirroring GSR Curs 7, Servicii de file sharing 14/45 rsync daemon I rsync --daemon I port implicit 873 I pentru configurare pe Debian I editat /etc/default/rsync I RSYNC ENABLE=true I /etc/init.d/rsync start j stop j restart I Configurare ^ın/etc/rsyncd.conf I man rsyncd.conf I format .ini (similar cu Samba) razvan@valhalla:/tmp$ cat /etc/rsyncd.conf [code] path = /home/razvan/code comment = Razvan's code GSR Curs 7, Servicii de file sharing 15/45 Client rsync I implicit foloses, te un shell razvan@valhalla:/tmp$ rsync localhost:code razvan@localhost's password: drwxr-xr-x 4096 2009/11/13 09:40:02 code I transfer folosind rsync daemon (de dou˘aori dou˘apuncte { `:') razvan@valhalla:/tmp$ rsync localhost::code drwxr-xr-x 4096 2009/11/13 09:40:02 . -rw-r--r-- 3 2009/11/13 09:40:02 .gitignore drwxr-xr-x 4096 2009/11/13 09:41:14 .git drwxr-xr-x 4096 2009/11/07 12:33:17 asm [...] I argumente uzuale sunt -avz GSR Curs 7, Servicii de file sharing 16/45 rsync + SSH I s, ir de c˘autare \rsync ssh" pe Google :-) I opt, iunea -e la rsync I nu necesit˘aserver de rsync I util pentru upload (sigur) I rsync -avz -e ssh remoteuser@remotehost:/remote/dir /this/dir/ I sincronizare I rsync -avz -e ssh /this/dir remoteuser@remotehost:/remote/dir I backup GSR Curs 7, Servicii de file sharing 17/45 rsync backup (cron) 1 #!/bin/bash 2 3 RSYNC=/usr/bin/rsync 4 SSH=/usr/bin/ssh 5 RUSER=so 6 RHOST=cursuri.cs.pub.ro 7 RPATH=/home/courses/so/public html/* 8 LPATH=/home/so/www/cs/ 9 #OPTS="-avz --include /wiki/images --exclude /wiki/* --exclude /wiki-old --exclude /Teme/note --exclude /Teme/upload --exclude /Teme/*.auth --exclude /functions.php" 10 OPTS="-avz --exclude /wiki-old --exclude /Teme/note --exclude /Teme/upload --exclude /Teme/*.auth --exclude /functions.php" 11 12 cd $LPATH&& $RSYNC $OPTS-e $SSH $RUSER@$RHOST:$RPATH $LPATH GSR Curs 7, Servicii de file sharing 18/45 Outline Partajarea fis, ierelor SSH. rsync NFS Samba FTP ^Incheiere ^Intreb˘ari GSR Curs 7, Servicii de file sharing 19/45 NFS I protocol de acces la fis, iere I montare ^ınret, ea I NFSv4 (RFC3010, RFC3530) I init, ial funct, iona peste UDP, ast˘azipeste TCP I RPC-based I nu exist˘aun port pe care ascult˘a I portmap (port mapper, rpcbind) { TCP/UDP port 111 I NFSv4.1 { pNFS (scalable parallel access) GSR Curs 7, Servicii de file sharing 20/45 Configurare server NFS I /etc/exports I Ce se partajeaz˘a?Ce stat, ii au acces? Cu ce drept? anaconda:~# cat /etc/exports /home/razvan/public_html/pub 141.85.37.75(rw,sync,subtree_check) I Dup˘amodificarea /etc/exports se ruleaz˘acomanda I exportfs -ra GSR Curs 7, Servicii de file sharing 21/45 Client NFS I montare I mount anaconda.cs.pub.ro:/home/razvan/public_html/pub pub I configurare /etc/fstab I montare automat˘ala pornire razvan@valhalla:~/nfs/anaconda/pub$ tail -1 /etc/fstab anaconda.cs.pub.ro:/home/razvan/public_html/pub /home/razvan/nfs/anaconda/pub nfs rw 0 0 GSR Curs 7, Servicii de file sharing 22/45 Utiliz˘ariNFS I directoare partajate la nivelul ret, elei locale I stocarea directoarelor home pe un singur sistem/server I directoare cu executabile pe un singur sistem (dac˘asunt sisteme identice) GSR Curs 7, Servicii de file sharing 23/45 Sisteme de fis, iere pentru clustere I Lustre (Linux cluster) I high performance file system I GlusterFS I NAS file system I cloud computing GSR Curs 7, Servicii de file sharing 24/45 SAN/NAS I Storage Area Network I discuri legate prin ret, ea la sistemele de procesare I SCSI I AoE, FC, HyperSCSI, iSCSI I Network Attached Storage I sisteme dedicate care asigur˘astocarea I elimin˘anevoia utiliz˘arii I FreeNAS (stripped-down version of FreeBSD) GSR Curs 7, Servicii de file sharing 25/45 SAN/NAS (2) GSR Curs 7, Servicii de file sharing 26/45 iSCSI I Internet Small Computer System Interface I SCSI commands over IP networks I SCSI clients { initiators I SCSI storage devices { targets I SAN I poate folosi infrastructura existent˘a(spre deosebire de FibreChannel) GSR Curs 7, Servicii de file sharing 27/45 Outline Partajarea fis, ierelor SSH. rsync NFS Samba FTP ^Incheiere ^Intreb˘ari GSR Curs 7, Servicii de file sharing 28/45 Samba I implementare free a SMB/CIFS I SMB { Server Message Block I CIFS { Common Internet File System I Andrew Tridgell (rsync) I network shares I doi daemoni I smbd { serviciu de file/printer sharing I nmbd { serviciu de mapare NetBIOS-IP GSR Curs 7, Servicii de file sharing 29/45 Configurare Samba I configur˘arilese realizeaz˘a^ın /etc/samba/smb.conf I fis, ier format .ini (similar rsyncd.conf :-P) I ^ınzona [global] este important˘aopt, iunea \netbios name" I nu apare implicit ^ınfis, ierul de configurare anaconda:~# cat /etc/samba/smb.conf | grep -v '^[#;]' | grep -v '^$' [global] workgroup = CS netbios name = anaconda server string = %h server dns proxy = no log file = /var/log/samba/log.%m max log size = 1000 syslog = 0 [...] GSR Curs 7, Servicii de file sharing 30/45 Configurare Samba (2) I directive pentru creare share-uri I implicit sunt partajate read-only directoarele home I pentru verificarea configurat, iei se foloses, te comanda testparm I se foloses, te smbpasswd pentru ad˘augarea unui utilizator ^ın Samba GSR Curs 7, Servicii de file sharing 31/45 Configurare Samba (3) I se adaug˘autilizatorul ^ınconfigurarea Samba anaconda:~# smbpasswd -a razvan New SMB password: Retype new SMB password: Testare configurat, ie