Apache Atlas : A Hands-on Course

Install Apache Atlas locally by downloading the 2.1.0 source, extracting, building with maven, and packaging with embedded edge base and Solr; then start Atlas and login at localhost:21000.

Load sample data into Atlas by running the quickstart.py script from the bin folder, entering admin admin credentials, and refreshing Atlas to see the created db and table entities.

Learn how atlas defines types and entities, using primitives, enums, arrays, maps, and composites, and how an entity instance inherits a super type and carries attributes and a geo ID.

Explore Atlas relationships by linking entities and entity types, such as a hive table related to a hive db, columns, and a storage descriptor, shown in the UI.

Explore atlas type attributes, including primitive attributes, optionality, indexability, uniqueness, and cardinality. Learn the difference between attribute defs and relationship attribute defs.

Explore system specific types in Apache Atlas, including referenceable asset, infrastructure dataset, and process, and learn how differentiable types define unique qualified names and attributes like name, description, and owner.

Discover data lineage in Atlas by tracing data from source to destination through transformations, using inputs and outputs of processes to form complete lineage.

Explore how Apache Atlas uses classification to group entities such as facts and dimensions, propagate classifications through data lineage, and manage attributes like PII and global address.

Explore classification propagation in Atlas, showing how the propagate option extends PII tags across data lineage and how deletions at the source or mid-path break propagation.

Explore Apache Atlas search, including basic and advanced modes, with type, classification, term, and text filters. Build complex queries using the entity attribute filter across table, system, and business attributes.

Master advanced search in Atlas UI by writing where clauses, using like filters, exploring relationships and classifications, and understanding the select clause order to locate tables and owners quickly.

Create glossaries with categories and terms in Apache Atlas, attach terms to entities like tables and columns, and apply propagation and classifications; search by term and safely delete.

Create MySQL DB, MySQL table, and MySQL column type definitions, build a sales entity, and establish lineage from the MySQL sales table to the sales fact table via ingestion.

Master Atlas type definitions by building mysql_db, mysql_table, and mysql_column using types rest and curl, with attributes, supertypes, and safe deletion guidance.

Create Atlas entities by using the REST API to define MySQL DB, table, and column, referencing sample data and payloads, and establish composition relationships between table and columns.

Create a relationship between a sales MySQL database and its sales MySQL table using Apache Atlas, by referencing existing relationships, identifying end definitions, and validating the connection in the ui.

Create a data lineage between the sales MySQL table and the sales fact table by defining an ingestion process, posting type and process definitions, and validating the linkage in Atlas.

Learn how ING uses Apache Atlas and Amundsen to enable data discovery through a metadata catalog and a scalable data onboarding workflow.

Compare Apache Atlas with LinkedIn Data Hub, Netflix Meta Cat, Uber Data Book, and Amazon by lift. Examine architectures, connectors, and open-source differences to inform choices.