Teach on Udemy

Turn what you know into an opportunity and reach millions around the world.

Learn More

Your cart is empty.

Keep shopping

Bluff Next: Processing Survey Data in GCS With QGIS 3.xx

Learn to process survey data, plotting in QGIS, creating spatial models and designing multi-layouts.

Created byJuni Muchlis Mustafa

Last updated 3/2025

English

What you'll learn

Introduction to the Geopackage format (.gpkg) in QGIS 3.34.x
Comparison of Shapefile and Geopackage formats
Export SHP data to GPKG in Geographic Coordinate System (GCS)
Process Survey data in XLS and export to CSV
Plotting survey point distribution in Decimal Degree from CSV and exporting to GPKG
Creating spatial modeling
Creating Multi-Layouts

Course content

6 sections • 27 lectures • 3h 29m total length

Courses Big Picture8:21
Brief description of all 5 sections in this course
Geopackage (GPKG) VS Shapefile (SHP)10:00
Geopackage/GPKG is a proprietary format of QGIS. We will compare Geopackage and ESRI Shapefile formats directly shows the differences, advantages and disadvantages of these two formats.

3.1. Processing XLS Data into GPKG10:38
Before being processed in QGIS, the field data in XLS format is first cleaned, such as column names that must not contain spaces. Then this XLS is exported to CSV. The CSV is then plotted onto the QGIS canvas using 2 (two) columns/fields of Longitude and Latitude coordinates. The results of this plotting are then exported to GPKG
3.2. Cleaning data with Geocoding techniques14:53
After the data is plotted and exported to GPKG, we will perform data cleaning. Every data always has errors, in spatial data often the location of the data that becomes an error such as the position of the point being off from where it should be. So we will shift these points using the existing attribute data, namely sub-district and village/urban village data. We already have SHP data for administrative polygons of villages and administrative polygons of sub-districts that have been exported to GPKG. This administrative polygon data is a reference in shifting the points that are off. This technique is called geocoding
3.3.Comparing field names in SHP and GPKG4:30
Field titles or names can be a disaster for us now or in the future if we use too many abbreviations such as road name becomes road_nm or income becomes incm. This happens in the SHP format where the field name contains 10 characters/letters including spaces. We have exported survey point plotting data from CSV to GPKG, the field names are complete, nothing is cut off. In this meeting we will export survey point plotting data from CSV to SHP and see the comparison of field titles between SHP and GPKG.

4.1. Fix wrong data type in an attribute table17:37
4.2. Create thematic maps7:24
In a QGIS Project document, we can create several thematic maps from one layer or several layers. These thematic maps can then be created in different layouts even in one QGIS Project document.
4.3. Create choropleth maps16:19
In this lecture, we will create a new QGIS/QGZ Project document. This New QGZ will create spatial modeling namely choropleth modeling, cluster modeling and heatmap modeling.
4.4. Add thousand separator6:23
Although not too disruptive, adding a thousands separator can make it easier for us to see data in thousands or millions. In this section we will add a thousands separator in the attribute table and in the spatial model.
4.5. Separate each spatial modelling into different Project QGZ4:22
We will separate the choropleth, cluster and heatmap spatial models into separate QGZ projects. This is done to make it easier for us to design multi layouts.

5.2. Designing layout for business type Thematic9:39
We will design a layout for a thematic gender map where this map is generated from thematically-fielded businessType in survey attribute data.
5.3. Designing layout for business duration Thematic4:11
We will design a layout for a thematic business duration map where this map is generated from thematically-fielded businessDurationin survey attribute data.
5.4. Designing layout for business asset Thematic3:52
We will design a layout for a thematic business asset map where this map is generated from thematically-fielded businessAsset survey attribute data.
5.5. Export thematic layout to JPG13:31
After designing the layout, we can then export this layout into another format such as JPG for presentation or reporting purposes.
5.6. Export Layout to PDF and save template5:57
After designing the layout, we can then export this layout into another format PDF for presentation or reporting purposes. We will also export this layout to template so may be used for another QGIS project layout in the future

6.1. Designing layout for Age Graduated Choropleth6:40
We will design a layout for a graduated choropleth of Age map where this map is generated from thematically-fielded Age in survey attribute data. Design is assisted by template which exported from another QGIS layout project
6.2. Designing layout for Age Cluster Choropleth3:58
We will design a layout for a cluster choropleth of Age map where this map is generated from thematically-fielded Age in survey attribute data.
6.3. Designing layout for Age HeatMap Choropleth6:40
We will design a layout for a heatmap choropleth of Age map where this map is generated from thematically-fielded Age in survey attribute data.
6.4. Designing layout for Monthly Income Graduated Choropleth6:40
We will design a layout for a graduated choropleth of monthly income map where this map is generated from thematically-fielded monthlyIncomeIDR in survey attribute data.
6.5. Designing layout for Monthly Income Cluster Choropleth4:49
We will design a layout for a cluster choropleth of monthly income map where this map is generated from thematically-fielded monthlyIncomeIDR in survey attribute data.
6.6. Designing layout for Monthly Income HeatMap Choropleth2:16
We will design a layout for a heatmap choropleth of monthly income map where this map is generated from thematically-fielded monthlyIncomeIDR in survey attribute data.
6.7. Designing layout for Annual Income Graduated Choropleth6:22
We will design a layout for a graduated choropleth of annual income map where this map is generated from thematically-fielded annualIncomeIDR in survey attribute data.
6.8. Designing layout for Annual Income Cluster Choropleth2:22
We will design a layout for a cluster choropleth of annual income map where this map is generated from thematically-fielded annualIncomeIDR in survey attribute data.
6.9. Designing layout for Annual Income HeatMap Choropleth2:22
We will design a layout for a heatmap choropleth of annual income map where this map is generated from thematically-fielded annualIncomeIDR in survey attribute data.
6.10. Export Layout into JPG and PDF9:16
Export maps layouts to JPG and PDF

Requirements

Require basic knowledge of QGIS operation
Require basic knowledge of data processing operations in Microsoft Windows (File Explorer)

Description

This Video tutorial is created using QGIS 3.34 LTR, however all QGIS 3.xx may use and follow this course.

1. Introduction to Geopackage (.gpkg),

GPKG is a proprietary format from QGIS. Although this format is relatively new, its popularity is rapidly increasing because many things offered by this format far surpass the Shapefile/SHP format. GPKG not only accommodates vector data but also raster data, spreadsheets, tile data and can even store QGIS Project Document (QGS/QGZ) so that GPKG is truly able to create an isolated environment for a project. GPKG can do this because GPKG is supported by the SQLite database so GPKG is not just a format but also a database.

2. Geopackage VS Shapefile.

SHP has been the de facto standard vector data format in the GIS industry for 40 years. When SHP was first launched, this format was supported by the most advanced technology at that time, for example DBF database support. Currently, DBF is no longer used because there are many weaknesses here and there. The vector data storage format was then developed again by still using database technology as the backbone of data storage but with much better adjustments. One of the data storage formats developed by QGIS is Geopackage/GPKG. GPKG is supported by a sophisticated, lightweight and easy-to-use SQLite database. We will go head to head to compare the advantages and disadvantages of the SHP and GPKG formats.

3. Export SHP to GPKG

GPKG is able to create new features but on this occasion we will export existing SHP data to GPKG, besides saving time, we can also practice. There are many formats that can be read by QGIS and all of them can be exported to GPKG. besides SHP, other popular data formats are KML and geoJSON.

4. Processing field survey data in XLS format, editing and cleaning data

Before being processed in QGIS, field data in XLS format is first cleaned/cleaned such as column names that must not have spaces.

5. Export XLS to CSV

After being cleaned, the XLS data is exported to CSV.

6. Plotting survey point distribution data CSV to QGIS, XY data in Geographic Coordinate System (GCS) in decimal degree (DD) format

The CSV data is then added and plotted to QGIS. Plotting or displaying the distribution of survey points on the QGIS canvas is done using 2 (two) columns/fields, a combination of X/Longitude/Longitude and Y/Latitude/Latitude as the coordinate points of the earth where the survey respondents are located. The coordinate system used in this course is the Geographic Coordinate System (GCS) with degrees (Degree) and in Decimal Degree/DD format

7. Export plotting data to GPKG

The distribution of survey points that have been added to the QGIS canvas is temporarily stored in memory (temporary layer), to make it permanent we will export this point distribution data to GPKG

8. Creating a spatial model

We will create a spatial model from the distribution of survey points that have been stored in GPKG. This spatial model can be in the form of thematic, choropleth, clustering and heatmap. The spatial model will provide a clearer picture of how this data is distributed based on the attribute data obtained such as the age spatial model, the monthly turnover spatial model, the annual turnover spatial model and others.

9. Designing multi-Layout in one QGIS project document (QGS/QGZ).

The advantage of creating a layout in QGIS is multi-Layout. We can create many layouts/multi-layouts from just one QGS. We are able to create layouts for each of the spatial models above from just one QGS/QGZ.

Who this course is for:

Beginning users who already understand the basics of QGIS operation

Bluff Next: Processing Survey Data in GCS With QGIS 3.xx

What you'll learn

Explore related topics

Course content

Introduction2 lectures • 18min

Processing SHP into GPKG2 lectures • 21min

Processing Survey Data3 lectures • 30min

Spatial Modelling5 lectures • 52min

Designing Multi-Layout Thematic Maps5 lectures • 37min

Designing Multi-Layout Choropleth Maps10 lectures • 51min

Requirements

Description

Who this course is for: