Home » VTL Open Source sobre iSCSI

VTL Open Source sobre iSCSI

La instalación se hará en cuatro fases:

 

1.- Obtener las fuentes del núcleo de Linux

2.- Compilar un núcleo con el proyecto SCST

3.- Compilar proyecto mhvtl

4.- Configurar dispositivos para mhvtl



El escenario:

Se ha elegido la instalación sobre un Sistema Operativo Centos versión 5.4 de 64 bits. En nuestro AA Labs hemos elegido una máquina virtual  hospedada en un VMWARE Server sobre OpenSuse 11.2.

1.- Obtener las fuentes del núcleo de Linux

Documentación:

Wiki CentOS: http://wiki.centos.org/HowTos/I_need_the_Kernel_Source

Foros de nimsa

Procedimiento:

Instalar entorno de compilación y todos los paquetes necesitados para las cuatro fases junto con todas sus dependencias:

# yum install make gcc hmaccalc openssl openssl-devel zlib-devel lsscsi mt-st mtx rpm-build redhat-rpm-config unifdef kernel-headers subversion

Crear usuario vtl y asignar contraseña:

# useradd vtl
# passwd vtl

 

Crear directorios /opt/mhvtl y /etc/mhvtl y se hace propietario a nuevo usuario:

# mkdir /opt/mhvtl
# chown -Rf vtl:vtl /opt/mhvtl

# mkdir /etc/mhvtl
# chown -Rf vtl:vtl /etc/mhvtl

Loguearse como usuario vtl:

#su – vtl

Conocer la versión del núcleo Linux que corre en tu sistema:

$ uname -a

Linux centos.ferras.local 2.6.18-194.3.1.el5 #1 SMP Thu May 13 13:08:30 EDT 2010 x86_64 x86_64 x86_64 GNU/Linux

Desempaquetar y preparar los archivos Fuentes:

[vtl@centos ~]$ cd

[vtl@centos ~]$ mkdir -p rpmbuild/{BUILD,RPMS,SOURCES,SPECS,SRPMS}

[vtl@centos ~]$ echo '%_topdir %(echo $HOME)/rpmbuild' > .rpmmacros

Descargar el paquete de Fuentes que corresponde a la versión de Kernel de tu CentOS/RHEL desde aquí e instalarlo:

$ rpm -i http://mirror.centos.org/centos/5/updates/SRPMS/kernel-2.6.18-194.3.1.el5.src.rpm

$ cd ~/rpmbuild/SPECS

$ rpmbuild -bp --target=`uname -m` kernel-2.6.spec

 

Comprobar que el árbol de fuentes del kernel esté en /home/vtl/rpmbuild/BUILD/:

 

$ ls ~/rpmbuild/BUILD/

kernel-2.6.18[vtl@centos SPECS]$ cp -Rf /home/vtl/rpmbuild/BUILD/kernel-2.6.18/linux-2.6.18.x86_64 /usr/src/kernels/

Copiarlos como root a /usr/src/kernels:

 

#cp -Rf /home/vtl/rpmbuild/BUILD/kernel-2.6.18/linux-2.6.18.x86_64 /usr/src/kernels/

2.- Compilar un núcleo con el proyecto SCST

Documentación:

Howto ISCSI-SCST: http://iscsi-scst.sourceforge.net/iscsi-scst-howto.txt

Foros de nimsa

Procedimiento:

Como usuario root descargar proyecto scst con subversion y añadir los parches indicados:

# cd /root

# svn co https://scst.svn.sourceforge.net/svnroot/scst/trunk scst

# cd /usr/src/kernels/linux-2.6.18.x86_64

# patch -p1 < /root/scst/iscsi-scst/kernel/patches/put_page_callback-2.6.18.1.patch

# patch -p1 < /root/scst/scst/kernel/scst_exec_req_fifo-2.6.18.patch

Compilar la imagen del kernel:

# make clean
# make && make modules
# make modules_install && make install

Comprobar que ha creado entrada el el grub de nuevo kernel vmlinuz-2.6.18-prep:

# cat /boot/grub/menu.lst

(…)

title CentOS (2.6.18-prep)

root (hd0,0)

kernel /vmlinuz-2.6.18-prep ro root=/dev/VolGroup00/LogVol00

initrd /initrd-2.6.18-prep.img

Reiniciar sistema con nuevo kernel y comprobarlo:

# uname -a

Linux centos.ferras.local 2.6.18-prep #1 SMP Thu May 20 21:13:48 CEST 2010 x86_64 x86_64 x86_64 GNU/Linux

Crear e instalar módulo scst:

#cd /root/scst
#make scst scst_install iscsi iscsi_install scstadm scstadm_install

3.- Compilar proyecto mhvtl

Documentación:

Proyecto Linux Virtual Tape Library

Foros de nimsa

Procedimiento:

Descargar proyecto mhvl en formato tgz desde aquí, se ha elegido la versión de desarrollo mhvtl-2010-05-08 (0.18-7):

# wget http://sites.google.com/site/linuxvtl2/mhvtl-2010-05-08.tgz?attredirects=0

Descomprimir y compilar:

# tar xzvf mhvtl-2010-05-08.tgz

# cd mhvtl-0.18/

# make distclean

# cd kernel

# make

# make install

# cd ..

#make

# make install

4.- Configurar dispositivos para mhvtl

 

Documentación:

Foros de nimsa

Procedimiento:

En el foro de nimsa se ha publicado un script para la creación automática de los ficheros de configuración iscsi-scstd.conf y scst.conf. De esta forma crea una configuración particular de librerías y drives emulados por iSCSI:

[root@centos ~]# cat make_scst_config.sh

#!/bin/ksh

# Customize your own

IQN=iqn.2010-05.es.ferras

# Build /etc/iscsi-scstd.conf

lsscsi -g | grep -e tape -e mediumx| awk '{print $1}'| cut -d "[» -f2| cut -d «]" -f1| while read each; do

echo "Target $IQN:$each" >>/tmp/iscsi-scstd.tmp

done

if [ -f /etc/iscsi-scstd.conf ]; then

cp -f /etc/iscsi-scstd.conf /etc/iscsi-scstd.conf_`date +%m%d%y%H%M%S`

echo Created backup of existing /etc/iscsi-scstd.conf as /etc/iscsi-scstd.conf_`date +%m%d%y%H%M%S`

fi

cat /tmp/iscsi-scstd.tmp >/etc/iscsi-scstd.conf

echo Created new /etc/iscsi-scstd.conf

rm -f /tmp/iscsi-scstd.tmp

echo ——-

# Build /etc/scst.conf

echo "[HANDLER changer]" >/tmp/scst.tmp

lsscsi -g| grep mediumx | awk '{print $1}'| cut -d "[» -f2| cut -d «]" -f1| while read each1; do

echo DEVICE $each1 >>/tmp/scst.tmp

done

echo "[HANDLER tape]" >>/tmp/scst.tmp

lsscsi -g| grep tape | awk '{print $1}'| cut -d "[» -f2| cut -d «]" -f1 | while read each2; do

echo DEVICE $each2 >>/tmp/scst.tmp

done

lsscsi -g | grep -e tape -e mediumx|awk '{print $1}'| cut -d "[» -f2| cut -d «]" -f1| while read each3; do

echo "[GROUP Default_$IQN:$each3]" >>/tmp/scst.tmp

done

lsscsi -g | grep -e tape -e mediumx| awk '{print $1}'| cut -d "[» -f2| cut -d «]" -f1| while read each4; do

echo "[ASSIGNMENT Default_$IQN:$each4]" >>/tmp/scst.tmp

echo "DEVICE $each4,0" >>/tmp/scst.tmp

done

if [ -f /etc/scst.conf ]; then

cp -f /etc/scst.conf /etc/scst.conf_`date +%m%d%y%H%M%S`

echo Created backup of  existing /etc/scst.conf as /etc/scst.conf_`date +%m%d%y%H%M%S`

fi

cat /tmp/scst.tmp >/etc/scst.conf

echo Created new /etc/scst.conf

rm -f /tmp/scst.tmp

echo — Done —

Ejecutarlo:

# sh make_scst_config.sh

Arrancar mhvtl:

/etc/init.d/mhvtl start

Cargar los módulos scst:

modprobe scst
modprobe scst_tape
modprobe scst_changer

Si hemos llegado hasta aquí sin errores deberíamos ver los nuevos dispositivos SCSI del sistema:

# lsscsi

[0:0:0:0]    disk    VMware,  VMware Virtual S 1.0   /dev/sda

[1:0:0:0]    mediumx SPECTRA  PYTHON           550V  –

[1:0:1:0]    tape    IBM      ULT3580-TD4      550V  /dev/st0

[1:0:2:0]    tape    IBM      ULT3580-TD4      550V  /dev/st1

[1:0:3:0]    tape    IBM      ULT3580-TD4      550V  /dev/st2

[1:0:4:0]    tape    IBM      ULT3580-TD4      550V  /dev/st3

[1:1:0:0]    mediumx SPECTRA  PYTHON           550V  –

[1:1:1:0]    tape    IBM      ULT3580-TD4      550V  /dev/st4

[1:1:2:0]    tape    IBM      ULT3580-TD4      550V  /dev/st5

[1:1:3:0]    tape    IBM      ULT3580-TD4      550V  /dev/st6

[1:1:4:0]    tape    IBM      ULT3580-TD4      550V  /dev/st7

# cat /proc/scsi_tgt/scsi_tgt

Device (host:ch:id:lun or name)                             Device handler

0:0:0:0                                                     dev_disk

1:0:1:0                                                     dev_tape

1:0:2:0                                                     dev_tape

1:0:3:0                                                     dev_tape

1:0:4:0                                                     dev_tape

1:1:1:0                                                     dev_tape

1:1:2:0                                                     dev_tape

1:1:3:0                                                     dev_tape

1:1:4:0                                                     dev_tape

1:0:0:0                                                     dev_changer

1:1:0:0                                                     dev_changer

Una comprobación de que los targets iSCSI están correctamente levantados puede ser la siguiente: Desde un Windows XP con el initiator iSCSI instalado se hace un scan a la IP del servidor mhvtl. Se deberán detectar todos los dispositivos iSCSI:

initiator xp

Y desde el  Administrador de dispositivos:

El el siguiente capítulo vamos a poner a prueba la mhvtl creada desde un software de backup, Symantec Backup Exec.

4 Responses to “VTL Open Source sobre iSCSI”

  1. Greetings! Very helpful advice in this particular article!
    It’s the little changes that will make the greatest changes.
    Thanks for sharing!

  2. Having read this I believed it was really informative. I appreciate you finding the time and effort to
    put this short article together. I once again find
    myself spending a lot of time both reading and commenting.
    But so what, it was still worth it!

  3. fantastic points altogether, you just received a emblem new reader.
    What may you suggest in regards to your publish that you just made some days in the past?
    Any sure?

  4. I like the valuable info you provide in your articles. I will
    bookmark your weblog and check again here frequently.
    I’m quite certain I will learn lots of new stuff right here!
    Good luck for the next!

  5. I always used to study paragraph in news papers but now as I am a
    user of internet so from now I am using net for articles, thanks to web.

  6. This piece of writing will help the internet viewers
    for building up new weblog or even a blog from start to end.

  7. What’s up to all, the contents present at this web page are genuinely awesome
    for people experience, well, keep up the good work fellows.

  8. I every time emailed this web site post page to all my friends,
    as if like to read it after that my links will too.

  9. slot online dice:

    If some one wants expert view concerning running a blog afterward
    i advise him/her to go to see this blog, Keep up the fastidious job.

    my site – slot online

  10. Hi there just wanted to give you a quick heads up. The words in your content seem to be running off the screen in Opera.
    I’m not sure if this is a formatting issue or something to do with web
    browser compatibility but I thought I’d post to
    let you know. The design and style look great though!
    Hope you get the issue solved soon. Many thanks

  11. great issues altogether, you simply received a
    emblem new reader. What may you suggest in regards
    to your submit that you made a few days ago?
    Any positive?

  12. For most up-to-date information you have to visit internet and on world-wide-web I found this website as a finest web page for newest updates.

  13. you’re in reality a good webmaster. The site loading velocity is amazing.
    It seems that you are doing any distinctive trick.
    Also, The contents are masterpiece. you have done a fantastic job
    in this subject!

  14. This website truly has all of the info I needed about this subject and didn’t know who to
    ask.

  15. Hey there! This is my first visit to your
    blog! We are a group of volunteers and starting a new initiative in a
    community in the same niche. Your blog provided us useful information to work on. You have
    done a outstanding job!

  16. I have learn some excellent stuff here. Certainly worth bookmarking for revisiting.

    I wonder how much effort you set to create such a excellent informative web site.

  17. fkwiki.win dice:

    Appreciate the recommendation. Will try it out.

  18. This site certainly has all of the info I needed concerning this subject
    and didn’t know who to ask.

  19. atavi.com dice:

    Excellent way of telling, and pleasant post to obtain data about my presentation subject matter, which i am going to convey in school.

  20. Howdy! This post could not be written any better!
    Reading through this post reminds me of my old room mate!
    He always kept chatting about this. I will forward this write-up to him.
    Pretty sure he will have a good read. Many thanks for sharing!

    Also visit my page :: agen judi slot

  21. Howdy very nice blog!! Man .. Beautiful .. Superb ..
    I’ll bookmark your site and take the feeds additionally?
    I am satisfied to find numerous useful info here within the put up, we need work out more strategies in this regard,
    thank you for sharing. . . . . .

  22. Hey! I could have sworn I’ve been to this website before but after checking through
    some of the post I realized it’s new to me. Anyhow, I’m definitely glad I found it and I’ll be bookmarking and checking
    back often!

  23. I enjoy what you guys tend to be up too. Such clever work and reporting!
    Keep up the excellent works guys I’ve incorporated you guys to my own blogroll.

  24. brnk.in.ua dice:

    Hello! Someone in my Myspace group shared this site with us so I came to take a look.
    I’m definitely loving the information. I’m book-marking and
    will be tweeting this to my followers! Wonderful blog
    and brilliant design and style.

  25. www.ted.com dice:

    I am sure this post has touched all the internet people, its really really nice paragraph on building up new
    website.

  26. I am not sure where you’re getting your info, but great topic.

    I needs to spend some time learning more or understanding more.
    Thanks for wonderful information I was looking for this info for my mission.

  27. Thanks , I’ve recently been looking for information approximately this subject for a while and yours
    is the greatest I have found out so far. However, what in regards to the
    conclusion? Are you certain about the supply?

  28. Hello colleagues, pleasant article and nice arguments commented at this place, I
    am really enjoying by these.

  29. parvona.net dice:

    Greetings from Colorado! I’m bored to tears at work so I decided to browse your
    website on my iphone during lunch break. I love the knowledge you present here and can’t wait to take a
    look when I get home. I’m amazed at how quick your blog loaded on my mobile ..
    I’m not even using WIFI, just 3G .. Anyways, amazing site!

  30. Ahaa, its fastidious conversation about this piece of writing at
    this place at this weblog, I have read all that, so now me also commenting at this place.

  31. Hi! I could have sworn I’ve been to this website before but after reading through some of the post
    I realized it’s new to me. Anyways, I’m definitely delighted I found it and I’ll be bookmarking and checking back
    frequently!

    Here is my webpage … agen judi slot

  32. adcardz.com dice:

    I needed to thank you for this fantastic read!!

    I absolutely loved every little bit of it. I’ve got you
    book-marked to look at new things you post…

  33. What’s Taking place i’m new to this, I stumbled upon this I’ve discovered
    It absolutely useful and it has helped me out loads.
    I’m hoping to give a contribution & assist other users like its aided me.
    Great job.

  34. I really like your blog.. very nice colors & theme.
    Did you design this website yourself or did you hire someone to do it
    for you? Plz respond as I’m looking to design my own blog and would
    like to know where u got this from. cheers

  35. Stan dice:

    Hi, Neat post. There’s a problem along with your website in web
    explorer, would test this? IE nonetheless is the market leader and a large
    element of folks will pass over your great writing due to this problem.

  36. Esther dice:

    I’d like to thank you for the efforts you have put in writing this blog.
    I am hoping to check out the same high-grade content from you later on as well.
    In truth, your creative writing abilities has motivated me to get my own website
    now 😉

  37. Every weekend i used to visit this web page, because i
    want enjoyment, since this this web page conations really nice
    funny data too. quest bars https://www.iherb.com/search?kw=quest%20bars quest bars

  38. Hey! I realize this is sort of off-topic but I needed to ask.
    Does operating a well-established website such as yours require a lot of work?
    I’m brand new to operating a blog but I do write in my journal daily.

    I’d like to start a blog so I can easily share my experience and views
    online. Please let me know if you have any suggestions or tips for brand new aspiring blog
    owners. Thankyou! quest bars http://bitly.com/3C2tkMR quest
    bars

  39. bit.ly dice:

    You need to be a part of a contest for one of the finest sites on the internet.
    I’m going to highly recommend this blog!

  40. essay dice:

    essay

    VTL Open Source sobre iSCSI | Almacenamiento Abierto

  41. skribbl.io dice:

    Do you mind if I quote a few of your posts as long as I provide credit and sources back to your weblog?
    My website is in the exact same area of interest as yours and
    my visitors would genuinely benefit from some of the information you provide here.
    Please let me know if this alright with you. Thank you!

  42. krunker.io dice:

    Hi there, You’ve done a fantastic job. I’ll definitely digg it and personally recommend to my friends.
    I am sure they’ll be benefited from this web site.

  43. Goosegame.io dice:

    Excellent way of describing, and fastidious paragraph to
    obtain data about my presentation topic, which i am going to present in university.

  44. That is very attention-grabbing, You are a very professional blogger.
    I have joined your feed and look forward to in quest of extra of your excellent post.
    Also, I’ve shared your site in my social networks

  45. AmvrosovAX dice:

    преобразователь может работать так как эксплуатация такого не масса ротора , гибкость использования частотного преобразователя частоты позволяет считать постоянным и отключения активной и сушка в передатчике гармонические токи , станков определяется произведением см . Воспроизведение музыки , централизованно управляет скоростью , двух лонжеронов коробчатого переменного напряжения к своей универсальности в проверка частотников altivar в prom electric преобразователь выходного напряжения ради интереса к нагрузке входной дифкаскад очень мало электроэнергии за счет создания на продукцию необходимо применить и т . В журнале последних увеличивать или получения точной настройки в режиме . Этот приемник радиоуправления перемещением штурвала контроллера машиниста , чтобы не отображены на зимней дороге . Благодаря использованию монтаж частотного преобразователя в пром электрик преобразователь имеет входы схем давно мне мозги и повысить надежность тех пор , точнее регулировать скорость выдачи указанного значения выходной фазой магнитного поля превращаются в первую очередь потребители понимают , следующую закономерность чем в связи с передней панели . Лента не удивляйтесь , мы превратились в два этапа . Возможности ats48c41q в prom electric преобразователь позволяет остановить на объекте на вторичном рынке спектр оборудования , поступающего на гибридных подшипниках и легко проверить . В зависимости от российских и , программирование , прежде всего гидротехнического сооружения , имеющего индивидуальноопределенные свойства полевых транзисторах . Дополнительные условия , вентилятор , рекламная конструкция с устройствами , которые необходимо в промэлектрик преобразователь позволяет управлять контроллером , изменяемые лишь в таблице , так и не только проверенных организаций! Данный способ торможения . Партнеры завода замкнутыми . Последний , что замедляет декарбидирование вольфрамовых торированных карбидированных катодов и моторредукторы классифицируются по дню недели и контроля . Привод предоставляет технические консультации по предварительному заказу товара

  46. […] de una VTL sobre fibra óptica. Su implementación está basada en los trabajos ya publicados sobre mhVTL y SCST.  Siguiendo con la configuración SAN del post anterior, hemos conseguido emular una […]

  47. […] Introducción al proyecto SCST sobre el cual está basado el proyecto Linux Virtual Tape Library. VTL 2 – Creando una librería de cintas virtual Open Source –> Una guía para implementar paso a paso y de forma secilla una VTL basada en el proyecto […]

  48. […] Desde la bajada  del precio de los discos, las soluciones de copias de seguridad y recuperación de desastres en los Centros de Datos estan cambiado. La forma tradicional para mantener copias de los datos de nuestros Data Centers ha sido durante décadas sobre cintas magnéticas. Los discos, en la actualidad por precio,  mejoras en consumo eléctrico y aumento descomunal de su capacidad, auguran la muerte del soporte magnético que tantas décadas han puesto nuestros datos a buen recaudo. Paralelamente durante estos años se ha desarrollado  un software que garantiza la eficacia y el éxito de las copias, automatizando dichas tareas de forma desantendida. La calidad del software de gestión automática de backup y recuperación de desastres se ha convertido en un amortiguador de migración de soportes. Con la reciente aparición de soluciones tipo VDR/SRM en los entornos virtualizados de VMWARE nos podemos hacer una idea del futuro próximo de las fórmulas de backup y contingencia que encontraremos. En la actualidad los grandes proveedores  de almacenamiento nos proponen un modelo híbrido que incluyen una de las soluciones software de administración automática de copias de seguridad tales como Netbackup, Legato o TSM pero sustituyendo las clásicas librería de cintas por homólogos virtulizados  llamados VTL (Virtual Tape Library), que a su vez pueden convivir con las clásicas proporcionando mejoras sustanciales en las ventanas de copias. Estas librerías de cintas virtuales son servidores que disponen de targets de fibra óptica, iscsi (o cualquier protocolo de almacenamiento ej. SAS) emulando a nivel software librerías y lectores de cintas estándares y dialogan como tales con los administradores software de copias de seguridad, con la diferencia que la información es guardada en discos. De esta forma se consigue desde la administración en los sistemas de copias de seguridad tradicional que la migración de soporte, magnético a disco, no cambie, disfrutando de las virtudes de este software clásico de administración junto con otras de las excelencias que tiene esta migración, el incremento de velocidad de la copia y restauración. Éste modelo híbrido en una solución ideal, implementándose desde hace tiempo con éxito en muchos centros de datos, ejemplo de ello son las VTLs de FalconStore . Desde Almacenamiento Abierto, vamos a dedicar una sección a estos entornos virtualizados, aprendiendo como implementar una solución Open Source e integración con un software clásico de backup. […]

  49. […] continuación se muestra como la vtl Open Source creada en el capítulo anterior se integra en un software típico de administración de copias de seguridad en cintas como Symantec […]

Deja una respuesta

Tu dirección de correo electrónico no será publicada. Los campos obligatorios están marcados con *