(Qgis) and bar charts (R)

Jan 11, 2015 - The goal of this analysis is to provide different visualisations of the data OCCUPY# ... online of users and developers of the two software.*.
7MB taille 5 téléchargements 372 vues
GI Systems and Science Assignment Exercise 2015_16 (1480 words) Student number : 15110910 January 11th of 2015

Analysis of the data OCCUPY#GrandParis :

Different distribution visualisations through mapping (Qgis) and bar charts (R)*

INTRODUCTION

OCCUPY#GrandParis is a data of approximately 1500 points collected through a series of public collaborative workshops, mainly in the north Paris banlieue. These points are related to public spaces pointed out by the participants. (5 CATEGORIES: occupations, actors, landmarks, memory, project + 6 TOPICS) The goal of this analysis is to provide different visualisations of the data OCCUPY#GrandParis to evaluate its spatial distribution (density) as its distribution by categories, topics, municipalities and workshops. The goal is to have a general and synthetic view of this still raw data which has been collected by pieces here and there. The outcomes are not spectacular but allow to make advance in this long term project research. The paper herein describes all the tools and operations that have been used to get the visualisations included. They are probably quite basic but were mostly unknown or unfamiliar to me before. This exercise has been a great opportunity to discover these basic tools and the amazing community online of users and developers of the two software.* « ..... ... .. »

USES OCCUPATIONS

LANDMARKS

ACTORS

DIMENSIONS x3 TIME x2

How this place is occupied ? How it is used ? What practices can be seen ?

SCULPTURES, GRAFFITI PARTIES, MUSIC, CREATION PLACES, STREET SPORTS

What does represent this place ? What building, what object is used as a landmark ?

SHOPS, MARKETS, STREET SELLING, OFFICES, FACTORIES, RESTAURANTS

Who occupies this place or its limits ? Who maintains it or works here ? Who is coming here ?

OCCUPY#Abcde the collaborative map of Abcde public spaces

PROJETCS

future : What could be better here? What should be changed or added ? What occupations could be fostered ?

MEMORY CHANGES

past :What is the imaginary of this place, to what memories it is linked ? What has changed or disapeared ?

see www.occupy.fr for more informations

PARKS, GARDENS TREES, FLOWERS, WATER AGRICULTURE, ANIMALS

URBAN CULTURES ECONOMIC LIFE NATURES IN TOWN

TOPICS x6 ASSOCIATIONS, POLITICAL, RELIGIOUS ORGANISATIONS

COMITMENT WALKS, PATHWAYS, SHORTCUTS, CROSSROADS TUBE, BUS, TRAIN ... SQUARES, HIGH STREETS, SPORTS, SCHOOLS, ADMINISTRATIONS

TRANSIT DAILY ORDINARY

*  I tried at the beginning to use only R for these visualisations but I quickly discovered that my capacities in code were not acceptable. And as I was working on Mac, away from the University, it was not possible to work with Arcgis so I decided to use Qgis.

QGIS

The Qgis project has been started with the WGS84 Coordinate Reference Systems because the original data had been produced with this CRS. It was a mistake because the dimensions are in degrees in this CRS. So it has been necessary to change to a french CRS (RGF93/Lambert-93) while the work was already engaged, as it will be explained below.

A. DATA

Before producing any visualisations, it has been necessary to treat the Occupy data as the different output areas data.

A1. Occupy#GrandParis data a.3 files

The original data is composed of 3 files, collected through 3 different opportunities : 1-OCCUPY is the main data (800 points) collected through about 10 workshops in 10 different places. 2-BiB (Banlieue is Beautiful) is a data of 300 points focused on cultural topic distributed on a larger territory (Plaine Commune), collected through a network of artists and institutions. 3-COOP is a data of almost 200 points collected through 3 workshops on a specific smaller territory (La Courneuve).

b. tables simplification, homogenization and merging

Then, it has been necessary to homogenise these 3 tables before merging them: The Table Manager plugin has been really useful to re-order and rename fields The Field calculator has been useful - to replace some values: regexp_replace("FIELD", 'textTOfind','textTOreplace') - to create ID for each feature before merging tables so it will be possible in the future to join again files that have been erased for simplification : $id Finally, I merged the tables in a single one named OCCUPY data with Vector/ Data Management Tools / Merge shapefiles to one

c. create OCCUPY-workshops shapefile

First, the Openlayers plugin has been installed so the Stamen layout (OpenStreetMap data) could be made visible. Then it has been possible to indicate the places of the workshops on a created shapefile, with one field for the name and another for the description of the workshops and their context.

A2. output areas

a. municipalities

A shapefile of the municipalities contours has been downloaded from the IAU website (Planning Institute for the Ile-de-France regional Authority). It has been saved in WGS84 CRS before being added to the project.

b. IRIS statistical perimeters :

These areas are defined by the INSEE (French Institute for Statistics). IRIS cells represent the minimal units allowed by the law for producing statistics, containing approximately 2000 inhabitants. These areas are more or less homogeneous in their urban forms and are from 3 types : H as housing, contain 2000 inhabitants ; A as activity, 1000 workers + less than 500 inhabitants ; and Z for the IRIS with very few inhabitants (sport, parks, cemeteries, quarries ...)

c. INSEE grid

Since a few years, in a process to offer comparable data with other european countries,the INSEE French Institute for Statistics has developed a statistical grid of 200x200 metres. Each cell has to contain minimum 11 households or it is joined with others. Initially I wanted to use this grid, but I could not because it is not drawn for areas where there are no inhabitants. I tried to complete the grid but I could not find the CRS with which it was produced.

d.200x200m grid

Then I had to Create a Grid Layer with the MMQGIS plugin. Initially I thought it was a 200x200 metres grid, but I later discovered that had defined it in degrees on the WGS84 CRS. In the CRS RGF93/Lambert-93 used later, it appeared to measure 140 x 220m.

A3. Combining OCCUPY data and output areas a. New fields for OCCUPY

With the MMQGIS plugin, we could process a Spatial Join between OCCUPY and Municipalities as IRIS and get 2 new fields to know for each OCCUPY feature within which municipality and which IRIS it is.

b. Counting OCCUPY features for each output areas polygons

With Vector/Analysis tools/Points in polygons it was possible to add a new field occ-CNT for each output areas layers.

B. VISUALISATIONS

Now that the data has been well prepared, it is possible to start working on visualisations

B1. Density visualisations 2D and 3D through the 3 output areas a. municipalities

To make visible only the names of the municipalities containing OCCUPY data we used a filter expression for labels : CASE WHEN ( "occ-CNT" > 1) THEN "L_CO" END

b. iris

A visualisation with the number of OCCUPY points by IRIS is not interesting because some of them very big appear very dense whereas they are not. To visualise the density in points / km2 it was necessary to create a new field with the field calculator : "occ-CNT" / $area * 1.000.000. That was when I discovered that the CRS should not be WGS84 with units in degrees but one in meter. Though I changed it to RGF93/ Lambert-93

c. grid

After creating a 2D visualisation of the OCCUPY points density within the 200x200 m grid, a 3D visualisation has been produced thank to the fantastic Qgis2threejs plugin. This plugin allows many settings and that is why it was possible to position the labels of the workshops on the top.

B2. Kernel Density Estimation 2D and 3D

With the plugin HeatMap (using Kernel Density Estimation) it was possible to create a Heat Map with particular settings for radius and cell size. To get a 3d visualisation of the KDE, the Raster / Conversion / Polygonize, raster to vector tool has been used to get the vector contours out of the raster. But before using the Qgis2threejs plugin we had to use the Vector/ Geometry tools / Simplify geometry tool or else the calculation is too heavy for the processor.

C. QCONSOLIDATE

Finally the Qconsolidate plugin has been used to create a package where the Qgis file is joined with a copy of all the shapefiles linked to the project.

R

It has been the occasion to explore the different parameters to produce bar charts. You could find further descriptions indicated into the R script between code lines.

1. ggplot + geom_bar 2. stacked and dodge bar chart visualisations 3. facet grid visualisations 4. different ways to subset data

OCCUPY (total) by categories in count

OCCUPY (subset) by categories in count

600

200

count

count

400

100 200

0

0 acteurs

mémoire

occupations

a1_cate

projets

repères

acteurs

mémoire

occupations

projets

a1_cate

Distribution by categories (in count) : it is interesting to have an alternative visualisation

repères

with the exclusion of data that were not collected through public workshops. This subset will be used for the following graphics. OCCUPY (subset) by categories in %

OCCUPY (subset) by topics in %

20%

30%

(..count..)/sum(..count..)

(..count..)/sum(..count..)

15% 20%

10%

10% 5%

0%

0% acteurs

mémoire

occupations

a1_cate

projets

repères

O1

O2

O3

a2_them

O4

O5

Distribution ( in % )by topics and categories : we can note a predominance of the actors and occupations topics, whereas categories are more or less balanced

O6

ITI

SQUARES, SHOPS, SCULPTURES, MARKETS, HIGH GRAFFITI STREETS, STREET

US ATION

SPORTS, SELLING, PARTIES,SCHOOLS, MUSIC, OFFICES, CREATION ADMIFACTO- PARTIES, SHORTCUTS, SELLING, TREES, FLOWERS, MUSIC, OFFICES, CROSSROADS CREATION WATER FACTO- POLITICAL, PARTIES, SELLING, PARTIES, TREES, FLOWERS, MUSIC, MUSIC, OFFICES, RELIGIOUS CREATION CREATION FACTOWATER SPORTS, POLITICAL, SELLING, SELLING, TREES, SCHOOLS, FLOWERS, OFFICES, OFFICES, RELIGIOUS ADMIWATER FACTOFACTO- SPORTS, POLITICAL, SHORTCUTS, TREES, TREES, FLOWERS, SCHOOLS, FLOWERS, RELIGIOUS CROSSROADS WATER ADMIWATER SPORTS, POLITICAL, POLITICAL, SHORTCUTS, SCHOOLS, RELIGIOUS RELIGIOUS CROSSROADS ADMI- SPORTS, SPORTS, SHORTCU S

RTS

NISTRATIONS RIES, PLACES, RESTAURANTS STREET SPORTS

RBAN MENT URES

SCULPTURES, WALKS, SHOPS, PARKS, MARKETS, GARDENS PATHWAYS, GRAFFITI STREET PLACES, TUBE, RIES, AGRICULTURE, RESTAURANTS BUS, STREET TRAIN ANIMALS SPORTS ...

ECONOMIC URBAN DAILY CULTURES LIFE ORDINARY

ASSOCIATIONS, SCULPTURES, SHOPS, SCULPTURES, PARKS,MARKETS, GARDENS GRAFFITI GRAFFITI STREET ORGANISATIONS PLACES, RIES, PLACES, AGRICULTURE, RESTAURANTS STREET STREETANIMALS SPORTS SPORTS

ECONOMIC NATURES URBAN CULTURES INTRANSIT TOWN LIFE

SQUARES, ASSOCIATIONS, SHOPS, SHOPS, PARKS,MARKETS, MARKETS, GARDENS HIGH STREETS, STREET STREET NISTRATIONS ORGANISATIONS RIES, RIES, AGRICULTURE, RESTAURANTS RESTAURANTS ANIMALS

ECONOMIC NATURES URBAN URBAN COMITMENT CULTURES CULTURES IN TOWN LIFE

SQUARES, ASSOCIATIONS, WALKS, PARKS, PARKS,PATHWAYS, GARDENS GARDENS HIGH STREETS,

SQUARES, ASSOCIATIONS, ASSOCIATIONS, WALKS, PATHWAYS, HIGH STREETS,

NISTRATIONS ORGANISATIONS TUBE, AGRICULTURE, AGRICULTURE, BUS, TRAIN ANIMALS ANIMALS ...

ECONOMIC ECONOMIC NATURES DAILY COMITMENT IN TOWN LIFE LIFE ORDINARY

NISTRATIONS ORGANISATIONS ORGANISATIONS TUBE, BUS, TRAIN ...

NATURES NATURES DAILY TRANSIT COMITMENT ORDINARY IN IN TOWN TOWN

SQUARES, SQUARES WALKS, P

NISTRATIO NISTRATIO TUBE, BU

DAILY COMITMENT TRANSIT COMITMENT ORDINARY

O1 O2 O3 O4 O5 O6 py.fr/coop G, une cartographie coop#MAPPING, Partageons collaborative notre une connaissance cartographie de coop#MAPPING, La Courneuve collaborative du territoire une cartes cartographie coop#MAPPING, de coop#MAPPING, sur Lawww.occupy.fr/coop Courneuve collaborative une une cartes cartographie cartographie de sur LaPartageons www.occupy.fr/coop Courneuve collaborative collaborative notre cartes connaissance de de sur La Lawww.occupy.fr/coop Partageons Courneuve Courneuve du territoire notre cartes cartes connaissance sur sur www.occupy.fr/coop Partageons www.occupy.fr/coop du territoire notre connaissa Pa Pa

Distribution by categories and topics : actors for transit are never quoted whereas citizens have many

ideas for transit solutions ; this paradox demonstrates that there should be more consultation in relation to these issues. We can notice for memory a majority of economic quotations. These territories indeed were much more industrial in their recent past and many shops have disappeared. OCCUPY (subset) by categories/topics in %

OCCUPY (subset) by categories/topics in %

10.0% 30%

a2_them O1 O2 O3

5.0%

O4 O5 O6

a2_them

(..count..)/sum(..count..)

(..count..)/sum(..count..)

7.5%

O1

20%

O2 O3 O4 O5 O6

10% 2.5%

0.0%

0% acteurs

mémoire

occupations

a1_cate

projets

repères

acteurs

OCCUPY (subset) by topics/categories in %

mémoire

occupations

a1_cate

projets

repères

OCCUPY (subset) by topics/categories in %

10.0% 20%

7.5%

acteurs mémoire occupations

5.0%

projets repères

2.5%

(..count..)/sum(..count..)

(..count..)/sum(..count..)

15%

a1_cate

a1_cate acteurs mémoire occupations projets

10%

repères

5%

0.0%

0% O1

O2

O3

a2_them

O4

O5

O6

O1

O2

O3

a2_them

O4

O5

O6

Distribution by topics and categories : we have used both stacked and dodge bar charts

representations. Perhaps the stacked visualisation is clearer. We will conserve that type for the other graphics.

HOW

PAST

WHAT

LANDMARKS

... .. » ACTORS un saxophoniste que j’ai déjà écouté 2 ou 3 fois » Ici, on vie du coin «m’ont raco « c’est au pied du pont de l’autoroute ; il peut servir d’abri MEMORY « des vieux Bretons USES dure, un ici des courses de pe ch en cas d’orage ou bien du soleil quand il cogne bien» CHANGES 60 ils organisaient OCCUPATIONS

WHAT DO YOU KNOW ABOUT THE PUBLIC SPACES OF YOUR NEIGHBOURHOOD ?

does re What?isWho the maintains imaginary of thisworks place, tothis what memories it is linked ? What could be better here? WhatWhat How is occupied ? Who occupies this place or its limits it or here ? place should be ch be in seen ? What«has .....changed or disapeared ?How it is used ? What practices can What Who is coming here ? tions particular could be fostered ? buildin

represent place ? occupaWhat could be better here? WhatWhat shoulddoes be changed or this added ? What Who occupies What tions in particular could be fostered ? building, what object is used as a landmark ? Who is comin TOPICS X6 What is the imaginary of this place, to what memories it is linked SCULPTURES, ? GRAFFITI SHOPS, MARKETS, STREET PARKS, GARDENS ASSOCIATIONS, SQUARE «Si on pouvait passer par le terrain de sport, l’accès serait beau« c’est au pied du pont de l’autoroute ; il peut servir « d’abri parfois au What has changed or disapeared ? PARTIES, MUSIC, CREATION SELLING, OFFICES, FACTO- TREES, FLOWERS, WATER POLITICAL, RELIGIOUS SPORTS,

WHO

WHAT

FUTURE

LANDMARKS D’ailleurs PLACES, ileny cas aSTREET und’orage trou grillage parAGRICULTURE, où on ANIMALS oule bien du soleil quand il cogne bien» un saxophon PROJETCS coup plus facile. SPORTS dans RIES, RESTAURANTS ORGANISATIONS NISTRATI ACTORS « des vieux Bretons du coin m’ont les années passe. raconté Avec unque vraidans passage je pourrais inviter ma grand-mère» 60 ils organisaient ici des courses de chien » Who occupies this place or its limits ? Who maintains it or works here ? URBAN

ECONOMIC LIFE

Who is coming here ? CULTURES TOPICS X6 What could be better here? What should be changed or added ? What occupa-

SCULPTURES, GRAFFITI

SHOPS, MARKETS, STREET

WHO

PAST

MEMORY CHANGES

WHAT

HOW

PAST

WHO

ACTORS

FUTURE

... .. »

« Ici, fairedans des les barbecues l’été, ilpasser y a pas de ver-au « des vieux jouer Bretons du m’ont raconté années MEMORY « parfois aussi des musiciens viennent sous lecoin pont ; il yon a vient que «Si on pouvait parmal le«terrain dep c’est USES dure, de un chien petit »PROJETCS côté sauvage»coup plus facile. 60écouté ils organisaient LANDMARKS un saxophonisteCHANGES que j’ai déjà 2OCCUPATIONS ou 3 foisici» des courses D’ailleurs il a und’or tro enycas passe. Avec un vrai passage je pourrai

PARKS, GARDENS

tionsMUSIC, in particular couldOFFICES, be fostered ? PARTIES, CREATION SELLING, FACTO- TREES, FLOWERS, WATER

ASSOCIATIONS,

NATURES IN TOWN

COMITMENT

What is the im P What has chan

SQUARES, HIGH STREETS, WALKS, PATHWAYS, coop#MAPPING, une cartographie collaborative de La Courneuve « parfois aussi des musiciens viennent jouercartes soussurlewww.occupy.fr/coop pont ; il y a SPORTS, SCHOOLS, ADMI-

SHORTCUTS, CROSSROADS

PAST

FUTURE

que j’ai déjà écouté 2 ou 3 fois » PLACES, STREET SPORTS RIES, RESTAURANTS AGRICULTURE, ANIMALS ACTORS ORGANISATIONS un saxophoniste NISTRATIONS TUBE, BUS, TRAIN ... «Si on pouvait passer par le terrain de sport, l’accès serait beauMEMORY « des vieux 60 ils organ facile. D’ailleurs il y a un trou dans le grillage par où on PROJETCS coup plusURBAN CHANGES ECONOMIC NATURES DAILY TRANSIT LIFEje pourrais IN inviter TOWN COMITMENT ORDINARY passe.CULTURES Avec un vrai passage ma grand-mère» POLITICAL, RELIGIOUS

What is the imaginary of this place, to what memories it is linked ? What could b Partageons notre connaissance du territoire What has changed or disapeared ? tions in partic

cartes sur www.occupy.fr/coop

FUTURE

coop#MAPPING, une cartographie collaborative de La Courneuve

TOPICS X6

WALKS, PATHWAYS, « des vieux Bretons du coin m’ont raconté que dans les années MEMORY «Si on pouv SHORTCUTS, CROSSROADS 60TRAIN ils...organisaient ici des courses de chien PROJETCS » CHANGES coup plus fa PLACES, STREET SPORTS RIES, RESTAURANTS AGRICULTURE, ANIMALS ORGANISATIONS NISTRATIONS TUBE, BUS, passe. Facet visualisation for 3 cities : First we can note that more data were collected for Saint-Denis and La Avec What could be better here? What should be changed or added ? What occupaURBAN ECONOMIC NATURES DAILY Courneuve because more in these We notecould a similar distribution in proportion tionsTRANSIT in particular be fostered ? CULTURES LIFEworkshops IN TOWNwere organised COMITMENT ORDINARY 2 cities. TOPICS X6 for Saint-Denis and Epinay, indeed the dataPartageons werenotrecollected with the same processes. However more SCULPTURES, GRAFFITI SHOPS, MARKETS, STREET PARKS, GARDEN coop#MAPPING, une cartographie collaborative de because La Courneuve cartes sur www.occupy.fr/coop connaissance du territoire «Si on pouvait passer par le terrain de sport, l’accès serait beauPARTIES, MUSIC, CREATION SELLING, OFFICES, FACTO- TREES, FLOWER plusalong facile. D’ailleurs il y aand un SPORTS trou dans le grillage par où on data is related to Nature for Epinay because this city hasPROJETCS beautiful coup parks the Seine easily accessible. PLACES, STREET RIES, RESTAURANTS AGRICULTURE, passe. Avecbeen un vraicollected passage je pourrais ma grand-mère» For La Courneuve the distribution is a little different maybe because it has for theinviter moment with a URBAN ECONOMIC small group of participants and with a focus TOPICS on actors. CULTURES LIFE I X6 SHOPS, MARKETS, STREET

PARKS, GARDENS

ASSOCIATIONS,

SQUARES, HIGH STREETS,

PARTIES, MUSIC, CREATION

SELLING, OFFICES, FACTO-

TREES, FLOWERS, WATER

POLITICAL, RELIGIOUS

SPORTS, SCHOOLS, ADMI-

FUTURE

PAST

SCULPTURES, GRAFFITI

5%

SHOPS, MARKETS, STREET

PARKS, GARDENS

ASSOCIATIONS,

PARTIES, MUSIC, CREATION

SELLING, OFFICES, FACTO-

TREES, FLOWERS, WATER

POLITICAL, RELIGIOUS

SPORTS, SCHOOLS, ADMI-

SHORTCUTS, CROSSROADS

PLACES, STREET SPORTS

RIES, RESTAURANTS

AGRICULTURE, ANIMALS

ORGANISATIONS

NISTRATIONS

TUBE, BUS, TRAIN ...

URBAN CULTURES

20% 15%

NATURES IN TOWN

coop#MAPPING, une cartographie collaborative de La Courneuve 10%

COMITMENT

cartes sur www.occupy.fr/coop

DAILY ORDINARY

TRANSIT

Partageons notre connaissance du territoire

5%

0%

0%

a1_cate La Courneuve

10%

5%

acteurs mémoire occupations projets repères

0%

(..count..)/sum(..count..)

20%

a2_them O1

15%

La Courneuve

(..count..)/sum(..count..)

ECONOMIC LIFE

SQUARES, HIGH STREETS, WALKS, PATHWAYS, coop#MAPPING, une cartographie collaborative de La Courneu

Epinay−sur−Seine

Epinay−sur−Seine

10%

SCULPTURES, GRAFFITI

10% 5%

20% 15%

Saint−Denis

Saint−Denis

5%

10% 5%

0%

0% O1

O2

O3

a2_them

O4

O5

O6

O3 O4 O5 O6

0%

10%

O2

acteurs

mémoire

occupations

a1_cate

projets

repères

Vitry−sur−Seine

Comparison in % of 3 data collection types :

- Some data has been collected thank to OSM or Google. We can see that they are mostly ordinary and only from actors and occupations categories. This demonstrates the interest of organising workshops of the Vitry-sur-Seine type to collect original and diversified data.

30%

O2 O3 O4 O5 O6

10%

0% acteurs

mémoire

occupations

a1_cate

projets

repères

Google and OSM

60%

(..count..)/sum(..count..)

a2_them O1 O2

40%

O3 O4 O5 O6

20%

0% acteurs

mémoire

a1_cate

occupations

repères

Banlieue is Beautiful

100%

75%

(..count..)/sum(..count..)

We can see that the sum of these different graphics allows a general analysis of the data collected and a better understanding of its distribution. It also informs us on the importance of collection processes, the advantage of the public workshops and the interest to organise thematic workshops.

O1

20%

- Banlieue is Beautiful was interesting because it allowed to collect data on grass root artists and on their production visible in public spaces ; these street-art productions became new landmarks.

Conclusion :

a2_them

(..count..)/sum(..count..)

- The Vitry-sur-Seine data are interesting because they completely have been provided through a unique public workshop during a neighbourhood festival.

a2_them

50%

O2 O5

25%

0% acteurs

a1_cate

repères