Linux Basics for Hadoop Administrators

Install Oracle VirtualBox, download the osboxes linux image, create a 64-bit vm, boot from the image, and log in with the Ice boxes credentials to obtain the vm ip.

Clone a virtual machine from a base image using a linked clone for a lightweight copy, reinitialize the MAC address, and configure bridged networking for desktop access via PuTTY.

Explore the Linux directory structure from the root to key folders like /bin, /etc, /var, /proc, /home, and /boot, and learn how each stores executables, configuration files, libraries, and data.

Demonstrate the Linux directory structure, navigating /, /bin, /proc, /home, and /var/log. Show login, root and sudo access, and basic file and device handling via Putty and symbolic links.

Learn how to list files and directories in Linux using ls and its common options, including -l, -a, -R, and -h, to reveal permissions, ownership, size, and last modified dates.

Learn to create directories in Linux with mkdir, including multiple and nested directories. Use -p for parents, -v for verbose output, and -m for permissions, then verify with ls.

Explore Linux file permissions - read, write, and execute - for owner, group, and others, using ls -l, chmod with symbolic and numeric modes, and examples like 664 and 754.

learn how to view and change file and directory ownership and group using chown and chgrp, including recursive updates with -R.

Learn how to create and manage local Linux user accounts using useradd/adduser, assign home directories, shells, groups, and expiry dates, view password storage in /etc/shadow, and set passwords with passwd.

Install the openssh-server package, edit the sshd_config to set the port and permit root login, then start the sshd service and test remote access using the server IP 192.168.0.104.

Learn to enable passwordless ssh between servers by generating an rsa key pair, copying the public key to the remote authorized_keys, and setting correct permissions for .ssh and authorized_keys.

Generate public and private keys with PuTTYgen on Windows, save them, copy the public key to Linux authorized_keys, set permissions, and log in with the private key for passwordless ssh.

Generate public and private keys, place the public key in the VM's authorized_keys, convert the private key to PuTTY format, then connect to the VM using the private key.

Learn to install mysql server on centos 7, configure repos, start the service, and secure it by setting the root password, disabling remote root login, and removing test data.

Create a MySQL database, add a user, and grant full privileges, then verify access by listing databases and creating tables for Hadoop integration.

Install and configure MIT Kerberos server (kdc and admin server), set the realm Hadoop.com, create the initial database and admin principal, start and enable kdc and kadmin, and apply ACLs.

Configure the admin server details and connect to the Kerberos server for Hadoop administration. Test port 88 connectivity, adjust firewall settings if needed, and obtain a Kerberos ticket with kinit.

Create a principal and its keytab file using the katu tool, configure 256-bit encryption, and obtain a ticket by using kinit with the keytab.

Use sudo to run commands with elevated privileges as a super user, controlled by the sudoers file and a password. Edit sudoers with visudo to set allowed users and commands.

Use sudo to run commands with elevated permissions, switch to root or another user with -u, manage password prompts, and review sudoers restrictions for host and user access.

Linux basics for hadoop administrators: create a user and grant sudo privileges by editing the sudoers file, detailing user or group entries, host restrictions, runas targets, and the no-password option.

Explore how to collect basic server data, including operating system version, kernel version, memory, processor, and disk usage, using commands like cat /etc/redhat-release, ls -l /etc/*release*, and getconf LONG_BIT.

Learn how to determine the kernel version using uname, /proc/version, and grep to filter for Linux, and how to share these details with vendors.

Learn to inspect Linux processor and disk details for Hadoop administration using /proc/cpuinfo, top for memory and processor usage, df -h for mounted volumes, and fdisk -l to list disks.

Explore memory usage on Linux systems using free -h, top, and cat /proc/meminfo to view total, used, and per-process memory and avoid performance issues.

Configure yum repositories for Hadoop administration by editing repo files under /etc/yum.repos.d, defining baseurl and enabled, and managing gpgcheck until you install Cloudera Manager packages.