Wednesday, October 31, 2018

Troubleshooting steps in Solaris / Linux / VXVM / VCS

Booting into Rescue Mode

Rescue mode provides the ability to boot a small Red Hat Enterprise Linux environment entirely from CD-ROM, or some other boot method, instead of the system's hard drive.
As the name implies, rescue mode is provided to rescue you from something. During normal operation, your Red Hat Enterprise Linux system uses files located on your system's hard drive to do everything — run programs, store your files, and more.
However, there may be times when you are unable to get Red Hat Enterprise Linux running completely enough to access files on your system's hard drive. Using rescue mode, you can access the files stored on your system's hard drive, even if you cannot actually run Red Hat Enterprise Linux from that hard drive.
To boot into rescue mode, you must be able to boot the system using one of the following methods[1]:
  • By booting the system from an installation boot CD-ROM.
  • By booting the system from other installation boot media, such as USB flash devices.
  • By booting the system from the Red Hat Enterprise Linux CD-ROM #1.
Once you have booted using one of the described methods, add the keyword rescue as a kernel parameter. For example, for an x86 system, type the following command at the installation boot prompt:
linux rescue
You are prompted to answer a few basic questions, including which language to use. It also prompts you to select where a valid rescue image is located. Select from Local CD-ROM, Hard Drive, NFS image, FTP, or HTTP. The location selected must contain a valid installation tree, and the installation tree must be for the same version of Red Hat Enterprise Linux as the Red Hat Enterprise Linux disk from which you booted. If you used a boot CD-ROM or other media to start rescue mode, the installation tree must be from the same tree from which the media was created. For more information about how to setup an installation tree on a hard drive, NFS server, FTP server, or HTTP server, refer to the earlier section of this guide.
If you select a rescue image that does not require a network connection, you are asked whether or not you want to establish a network connection. A network connection is useful if you need to backup files to a different computer or install some RPM packages from a shared network location, for example.
The following message is displayed:
The rescue environment will now attempt to find your Linux installation and mount it under the directory /mnt/sysimage. You can then make any changes required to your system. If you want to proceed with this step choose 'Continue'. You can also choose to mount your file systems read-only instead of read-write by choosing 'Read-only'. If for some reason this process fails you can choose 'Skip' and this step will be skipped and you will go directly to a command shell.
If you select Continue, it attempts to mount your file system under the directory /mnt/sysimage/. If it fails to mount a partition, it notifies you. If you select Read-Only, it attempts to mount your file system under the directory /mnt/sysimage/, but in read-only mode. If you select Skip, your file system is not mounted. Choose Skip if you think your file system is corrupted.
Once you have your system in rescue mode, a prompt appears on VC (virtual console) 1 and VC 2 (use the Ctrl-Alt-F1 key combination to access VC 1 and Ctrl-Alt-F2 to access VC 2):
sh-3.00b#
If you selected Continue to mount your partitions automatically and they were mounted successfully, you are in single-user mode.
Even if your file system is mounted, the default root partition while in rescue mode is a temporary root partition, not the root partition of the file system used during normal user mode (runlevel 3 or 5). If you selected to mount your file system and it mounted successfully, you can change the root partition of the rescue mode environment to the root partition of your file system by executing the following command:
chroot /mnt/sysimage
This is useful if you need to run commands such as rpm that require your root partition to be mounted as /. To exit the chroot environment, type exit to return to the prompt.
If you selected Skip, you can still try to mount a partition or LVM2 logical volume manually inside rescue mode by creating a directory such as /foo, and typing the following command:
mount -t ext3 /dev/mapper/VolGroup00-LogVol02 /foo
In the above command, /foo is a directory that you have created and /dev/mapper/VolGroup00-LogVol02 is the LVM2 logical volume you want to mount. If the partition is of type ext2, replace ext3 with ext2.
If you do not know the names of all physical partitions, use the following command to list them:
fdisk -l
If you do not know the names of all LVM2 physical volumes, volume groups, or logical volumes, use the following commands to list them:
pvdisplay
vgdisplay
lvdisplay
From the prompt, you can run many useful commands, such as:
  • ssh, scp, and ping if the network is started
  • dump and restore for users with tape drives
  • parted and fdisk for managing partitions
  • rpm for installing or upgrading software
  • joe for editing configuration files
    Note
    If you try to start other popular editors such as emacs, pico, or vi, the joe editor is started.

5.2.1. Reinstalling the Boot Loader

In many cases, the GRUB boot loader can mistakenly be deleted, corrupted, or replaced by other operating systems.
The following steps detail the process on how GRUB is reinstalled on the master boot record:
  • Boot the system from an installation boot medium.
  • Type linux rescue at the installation boot prompt to enter the rescue environment.
  • Type chroot /mnt/sysimage to mount the root partition.
  • Type /sbin/grub-install /dev/hda to reinstall the GRUB boot loader, where /dev/hda is the boot partition.
  • Review the /boot/grub/grub.conf file, as additional entries may be needed for GRUB to control additional operating systems.
  • Reboot the system.
     

    Linux – LVM Free Training / Tutorial

    Link - https://www.unixarena.com/2013/08/linux-lvm-free-training-tutorial.html/

    In UnixArena Tutorial series, Here we are going to see about Linux’s  Logical volume manager which is default volume manage on all of the Linux flavors which are available now a days in market.In this tutorial, you will learn how to integrate, operate, LVM on Redhat Linux. This training provides instruction on operational management procedures for LVM and you will learn how to install and configure LVM and how to manage disks,volume groups, and volumes by using the command line.The advantage of using LVM is that space can be added to or removed from logical volumes as needed on demand basis.For your kind information , I am not going to explain LVM  theory in depth on this tutorial. 
    Prerequisites:
    1.Skills:Knowledge of LINUX/UNIX system administration.
    2.Lab: VM RHEL 6  or physical machine with RHEL 6.0
    Logical Volume Manager objects:
    There are several Logical Volume Manager objects that must be understood before you can use the LVM  to perform disk management tasks:
    Physical objects:
    Physical disks – Its a physical disk or LUN from storage.
     
    Disk groups: 
    A disk group is a collection of physical disks that share a common configuration.
     
    Volumes:
    A volume is a virtual disk device that appears to applications, databases, and file systems like a physical disk partition, but does not have the physical limitations of a physical disk partition.

    Overall LVM configuration Layout:
     
  •  
  • In this tutorial,we are going to cover the below topics.In the end of these tutorials you will very familiar with Logical volume manager and its operation.Your suggestions are always welcome to improve this tutorial.
    Topics Description
    Installation of LVM using YUM Step by Step Guide of LVM installation
    Disk operations on LVM LVM disk operations & Replacing Failed Disk
    Volume Group operations on LVM Step by Step Guide for volume group operation
    Volume creation and supported volume Layouts Step by Step Guide for Volume Creation
    Resizing a Logical volume How to resize the volume? Step by Step Guide
    Various LVM volume Attributes Discuss about various LVM attributes
    LVM Relayout – Volume conversion How to convert Existing volume layouts
    LVM snapshots Step by Step Guide for Volume snapshots

    I am very sure you may gone through each and every topic and learned about LVM.

    If you have any doubts,Please leave a comment.I will get back to you .

    Visit World’s bests volume manage aka Veritas volume manager training/tutorial page from here.   
  •  
  •  
  • Solaris Troubleshooting Skills
  •  
  • https://www.thegeekdiary.com/a-beginners-guide-to-solaris-performance-monitoring-and-troubleshooting/
     
     Solaris Boot Issue
http://www.adminschoice.com/booting-problems-in-solaris

Veritas Volume Manager (VxVM)

Private region data corruption recovery in VXVM

 
Plex Issue troubleshooting 








Disk Issues in VxVM

Link - https://www.veritas.com/support/en_US/article.000080622
           https://www.thegeekdiary.com/vxvm-tutorials-replacing-a-failed-disk-under-vxvm/

VXVM  Guide from installation to configuration

Link - https://www.unixarena.com/2013/03/vxvm-veritas-volume-manager-training.html/





VCS (Veritas Cluster Server)

Architecture of VCS
         
Link - https://sort.veritas.com/public/documents/sf/5.0MP3/solaris/html/sfrac_admin/ch01s03s07s01.htm

https://www.veritas.com/content/support/en_US/doc/133049644-133049647-0/br74_v8608563-133049647

Troubleshooting in VCS

Link - https://www.unixarena.com/2014/07/troubleshoot-vcs-cluster-starting.html/
           http://unixadminschool.com/blog/2011/11/vcs-starting-llt-gab-and-vcs-manually/
           https://www.thegeekdiary.com/troubleshooting-solaris-ipmp/
          https://vox.veritas.com/t5/Cluster-Server/VCS-Cluster-not-starting/td-p/617224


Performing activities on servers which are in VCS

Troubleshooting in issues for split brain

Link - https://www.thegeekdiary.com/vcs-cluster-101-communication-faults-jeopardy-split-brain-io-fencing/

https://www.veritas.com/support/en_US/doc/122863985-122863998-0/uxrt-72_v6528242-122863998

http://www.unixbabuforum.in/2013/10/WhatIsSplitBraininVCS.html

VCS Cluster - can perform activities for cluster build

Link - https://sort-static.veritas.com/public/documents/sfha/6.0/solaris/productguides/pdf/vcs_admin_60_sol.pdf

 https://www.veritas.com/content/support/en_US/doc/ka6j0000000BNlfAAG

Wednesday, June 6, 2018

Check multipathing on Solaris servers

https://www.thegeekdiary.com/a-beginners-guide-to-solaris-multipathing-software-mpxio-stms

Tuesday, May 24, 2016

Sun Cluster Installation / Configuration / Quorum Device Configuration / Resource Group / HA Zone on Solaris Cluster

http://www.unixarena.com/2014/06/configure-solaris-two-node-cluster-solaris-10.html

http://www.unixarena.com/2014/06/configure-quorum-devices-solaris-cluster.html

http://www.unixarena.com/2014/07/create-resource-group-solaris-cluster.html

http://www.unixarena.com/2014/07/configure-high-availability-zone-solaris-cluster.html

http://www.unix-openlab.com/media/Sun-Cluster-3-2-Cheat-Sheet.pdf

http://www.datadisk.co.uk/html_docs/sun/sun_cluster_32.htm


Fileystem Management in Solaris

http://solarisfacts.blogspot.in/p/solaris-file-system.html

http://solaris10commands.blogspot.in/2010/09/managing-solaris-os-file-system.html

Patching in Solaris

Solaris 10: Patching Solaris 10 on servers with non-global zones

http://unixadminschool.com/blog/2011/10/solaris-10-patching-solaris-10-on-servers-with-non-global-zones/

Applying a Patch to a Solaris System With Zones Installed

https://docs.oracle.com/cd/E19044-01/sol.containers/817-1592/z.pkginst.task-34/index.html

Managing Your Oracle Solaris Cluster Environment

http://www.informit.com/articles/article.aspx?p=1635203&seqNum=8

Solaris 10- OS patching using Live-upgrade

http://www.unixarena.com/2012/07/solaris-10-os-patching-using-live.html 

How To Apply A Solaris Recommended Patch Cluster

http://www.solariscommands.com/operating-system/how-to-apply-a-solaris-recommended-patch-cluster/

 

 


Thursday, March 3, 2016

Notes on configuring NFS on Solaris 10




March 16, 2007 at 1:36 am · Filed under OS, Solaris 10, Technology, howto

Here are my notes that I put together based on reading man pages, config sample, and from my previous blog entry on this topic.

1. (optional) mount an extra disk on the machine that will be the NFS server.
2. enable NFS sever by running the following:
svcadm -v enable -r network/nfs/server
3. Run the following command to share via NFS
share -F nfs -o rw /disk
Note: The above share command will not persist over reboots. To persist over reboots, add an entry to
/etc/dfs/dfstab

share -F nfs -o rw /disk

4. Run the following command to mount from the client side:
mount -F nfs server:/disk /mount_point
Note: The above mount command will not persist over reboots. To persist over reboots, add the following line in
/etc/vfstab:

server:/disk   -   /mount_point   nfs   -   yes    rw,soft

See also this vfstab sample.

Please note that you can’t use the root account on the NFS client host to create files, because root on the NFS client doesn’t mean root on the NFS server. Use a common user account across NFS server and client(s) instead.

 

Solaris Page................


Installing the Solaris Operating System          Installing Solaris 8
         Installing Solaris 9
         Installing Solaris 10

Patching the Solaris Operating System          Patching Solaris 8
         Patching Solaris 9
         Patching Solaris 10

Storage Management          Adding SCSI Host Adapter (X6541A) into a Blade 100/150
         Adding Second IDE Hard Drive into a Blade 100/150
         Connecting to an iSCSI Target with Open-iSCSI Initiator using Solaris
         Disk Partition Examples
         Determining Disk Throughput
         NFS a Remote File System on Solaris
         Sample /etc/vfstab File
         fsck Process
         Understanding Disk Device Files (i.e. breaking down c0t2d0s7)
         Removing Invalid Disk Device Files (/dev/dsk and /dev/rdsk)

Configuration and Administration Tips          Free IT - Software and Development Magazines!
         KVM Switches For the Home and the Enterprise - (Avocent)
         Booting Options and Using EEPROM
    Configuring Telnet / FTP to Login as root
         Power Management (Sun Blades Only)
         Using Package Manager on Solaris
         Diagnostic and System Configuration Information Commands
         Configuring apropos and whatis - (The windex file)
         Sun Serial Port & Cable Pinouts
         Connecting to Serial Consoles (Solaris / Linux)
         Determine Which Package a Particular File Belongs To
         Cannot open '/etc/path_to_inst'
         Using NFS on Solaris
         Where is Mozilla in Solaris 10 x86?

Solaris Volume Manager - (Solaris 9)          Solaris Volume Manager Data Sheet - (Solaris 9)
         Introduction
         Installing
         Command Line Tools
         Starting the Volume Manager Console GUI - (Enhanced Storage)
         Creating Volumes - (Using Solaris 9 Volume Manager Commands)
             State Database - (State Database Replicas)
             Creating a Stripe - (RAID 0)
             Creating a Concatenation - (RAID 0)
             Creating Mirrors - (RAID 1)
             Creating a RAID5 Volume - (RAID 5)
             Creating a Hot Spare
         Removing Volumes - (Using Solaris 9 Volume Manager Commands)
             Removing a State Database Replica
             Removing a Stripe - (RAID 0)
             Removing a Concatenation - (RAID 0)
             Removing a Mirror - (RAID 1)
             Removing a RAID5 Volume - (RAID 5)
             Removing a Hot Spare

Solstice DiskSuite - (Solaris 2.5.1 - Solaris 8)          Solstice DiskSuite Software Data Sheet - (Solaris 8)
         DiskSuite Support Matrix
         Introduction
         Installing
         Command Line Tools
         Creating Metadevices - (Using DiskSuite 4.2.1 Commands)
             Metadevice State Database - (State Database Replicas)
             Creating a Stripe - (RAID 0)
             Creating a Concatenation - (RAID 0)
             Creating Mirrors - (RAID 1)
             Creating a RAID5 Volume - (RAID 5)
             Creating a Trans Metadevice
             Creating a Hot Spare
         Removing Metadevices - (Using DiskSuite 4.2.1 Commands)
             Removing a State Database Replica
             Removing a Stripe - (RAID 0)
             Removing a Concatenation - (RAID 0)
             Removing a Mirror - (RAID 1)
             Removing a RAID5 Volume - (RAID 5)
             Removing a Trans Metadevice
             Removing a Hot Spare

Process Management with Solaris          Using the "truss" Command in Solaris

Configuring TCP/IP on Solaris          TCP/IP Configuration Files - (Quick Config Guide)
         Introduction / Pre-Requisites
         TCP/IP Configuration Files
         Network Databases and nsswitch.conf File
         Network Configuration Procedures
         Configuring Standard TCP/IP Services
         Overview of the Booting Processes

Configuring Routers in Solaris          Routing Protocols
         Configuring Routers

Solaris Links          Sun Product Documentation
         SunSolve Home
         Sunfreeware.com (Freeware For Solaris)
         SunHELP
         Getting Started with Solaris 8
         Sun Blueprints Online (Contains Sun's Best Practices)
         fixsolaris8.txt
         Unix File System Journalling also called Logging
         Solaris Installation Tips and how to Tighten Security
         Solaris Central
         DNS under Solaris
         Solaris 2.x - Tuning Your TCP/IP Stack and More
         Sun Store (U.S.)
         Connecting a Private Network to an ISP with Solaris
         Network / System Troubleshooting, SNMP, Apache, Veritas, and Much More
         Using Device Path Names to Identify System Devices
         Solaris Developer Connection / Solaris TechFAQS
         Netscape for the Solaris Operating Environment
         Solaris Live Upgrade 2.0
         Sun Managers Mailing List
         Sun Managers Summaries Archives
         Solaris Security Toolkit (JASS)
         Solaris Troubleshooting (Princeton University)
         Sun init Levels (Princeton University)
         searchenterpriselinux.com/
         BigAdmin System Administration Portal
         Sun Performance Tuning
         FOCUS on Sun: Installing Solaris
         FOCUS on Sun: Solaris Default Processes and init.d Part I
         FOCUS on Sun: Solaris Default Processes and init.d Pt. II
         FOCUS on Sun: Solaris Default Processes and init.d Pt. III
         FOCUS on Sun: Solaris Access Control Lists
         FOCUS on Sun: Securing Solaris
         Solaris Package Archive Information
         Solaris2/FAQ (Maintained-by: Casper Dik)
         Free Solaris[sm] Binary License Program
         Solaris 2.x (Tips, Tuning, etc.)
         Stokely Consulting - Unix Serial Port Resources
         FAQABOSS: Frequently Asked Questions About Buying an Old (Used) Sun System
         Multi-booting Solaris and other operating systems
         PatchReport (rev. 2.x) -- Solaris patch tool for 5.x, 7, 8

DevOps from Zero to Hero --> https://www.youtube.com/watch?v=Ou9j73aWgyE&list=PLdpzxOOAlwvIKMhk8WhzN1pYoJ1YU8Csa