Skip to content

Commit

Permalink
Merge pull request #13 from BU-Spark/zmeurer-citizen-cleaning-with--2
Browse files Browse the repository at this point in the history 
Citizen data cleaning incorporating incorrect -2 values work
  • Loading branch information
@zacharymeurer
zacharymeurer authored Jun 13, 2024
2 parents b230181 + 06c4e8e commit 5adfcb6
Show file tree
Hide file tree
Showing 72 changed files with 1,218,181 additions and 573,368 deletions.
598 changes: 311 additions & 287 deletions -2_values.ipynb
View file

Large diffs are not rendered by default.

9,781 changes: 4,763 additions & 5,018 deletions all data/citizen/andaman_and_nicobar_islands.csv
View file

Large diffs are not rendered by default.

4,290 changes: 1,019 additions & 3,271 deletions all data/citizen/andhra_pradesh.csv
View file

Large diffs are not rendered by default.

148 changes: 57 additions & 91 deletions all data/citizen/arunachal_pradesh.csv
View file

Large diffs are not rendered by default.

1,373 changes: 474 additions & 899 deletions all data/citizen/assam.csv
View file

Large diffs are not rendered by default.

201 changes: 98 additions & 103 deletions all data/citizen/bihar.csv
View file

Large diffs are not rendered by default.

97 changes: 3 additions & 94 deletions all data/citizen/chandigarh.csv
View file
Original file line number Diff line number Diff line change
@@ -1,94 +1,3 @@
Date_of_observation,Species_name,Leaves_fresh,Leaves_mature,Leaves_old,Flowers_bud,Flowers_open,Flowers_male,Flowers_Female,Fruits_unripe,Fruits_ripe,Fruits_open,Year,Week,Lat,Long,Observation_ID,User_id,User_Tree_id
2016-08-28,Amla-Phyllanthus emblica,1.0,1.0,,0.0,0.0,,,0.0,1.0,,2016,31,30.74667,76.79424,138246.0,15050.0,8194.0
2016-09-05,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,0.0,1.0,,2016,32,30.74667,76.79424,138247.0,15050.0,8194.0
2016-09-12,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,32,30.74667,76.79424,138248.0,15050.0,8194.0
2016-09-19,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,33,30.74667,76.79424,138249.0,15050.0,8194.0
2016-09-26,Amla-Phyllanthus emblica,2.0,2.0,,1.0,0.0,,,0.0,0.0,,2016,34,30.74667,76.79424,138250.0,15050.0,8194.0
2016-08-22,Amla-Phyllanthus emblica,2.0,1.0,,1.0,1.0,,,1.0,2.0,,2016,30,30.74667,76.79424,135909.0,15050.0,8194.0
2016-05-27,Amla-Phyllanthus emblica,2.0,2.0,,0.0,1.0,,,1.0,0.0,,2016,19,30.74667,76.79424,135891.0,15050.0,8194.0
2016-06-03,Amla-Phyllanthus emblica,2.0,2.0,,1.0,0.0,,,0.0,0.0,,2016,19,30.74667,76.79424,135893.0,15050.0,8194.0
2016-06-10,Amla-Phyllanthus emblica,2.0,1.0,,1.0,0.0,,,0.0,0.0,,2016,20,30.74667,76.79424,135895.0,15050.0,8194.0
2016-06-17,Amla-Phyllanthus emblica,1.0,2.0,,1.0,0.0,,,1.0,0.0,,2016,21,30.74667,76.79424,135897.0,15050.0,8194.0
2016-06-24,Amla-Phyllanthus emblica,1.0,1.0,,1.0,1.0,,,1.0,0.0,,2016,22,30.74667,76.79424,135899.0,15050.0,8194.0
2016-07-04,Amla-Phyllanthus emblica,1.0,1.0,,1.0,1.0,,,0.0,0.0,,2016,23,30.74667,76.79424,135902.0,15050.0,8194.0
2016-07-18,Amla-Phyllanthus emblica,1.0,1.0,,1.0,1.0,,,1.0,0.0,,2016,25,30.74667,76.79424,135904.0,15050.0,8194.0
2016-07-25,Amla-Phyllanthus emblica,1.0,1.0,,1.0,0.0,,,1.0,1.0,,2016,26,30.74667,76.79424,135905.0,15050.0,8194.0
2016-08-01,Amla-Phyllanthus emblica,1.0,1.0,,0.0,1.0,,,1.0,1.0,,2016,27,30.74667,76.79424,135906.0,15050.0,8194.0
2016-08-08,Amla-Phyllanthus emblica,1.0,1.0,,0.0,1.0,,,1.0,2.0,,2016,28,30.74667,76.79424,135907.0,15050.0,8194.0
2016-08-15,Amla-Phyllanthus emblica,2.0,1.0,,0.0,1.0,,,1.0,2.0,,2016,29,30.74667,76.79424,135908.0,15050.0,8194.0
2016-07-08,Amla-Phyllanthus emblica,1.0,2.0,,1.0,1.0,,,1.0,0.0,,2016,24,30.74667,76.79424,135901.0,15050.0,8194.0
2016-10-03,Amla-Phyllanthus emblica,2.0,2.0,,1.0,0.0,,,1.0,0.0,,2016,35,30.74667,76.79424,140056.0,15050.0,8194.0
2016-10-10,Amla-Phyllanthus emblica,2.0,2.0,,1.0,0.0,,,0.0,0.0,,2016,36,30.74667,76.79424,140057.0,15050.0,8194.0
2016-10-17,Amla-Phyllanthus emblica,2.0,1.0,,2.0,1.0,,,1.0,1.0,,2016,37,30.74667,76.79424,140058.0,15050.0,8194.0
2016-10-24,Amla-Phyllanthus emblica,1.0,2.0,,1.0,1.0,,,1.0,0.0,,2016,38,30.74667,76.79424,145527.0,15050.0,8194.0
2016-11-07,Amla-Phyllanthus emblica,2.0,2.0,,1.0,1.0,,,1.0,1.0,,2016,40,30.74667,76.79424,145529.0,15050.0,8194.0
2016-10-31,Amla-Phyllanthus emblica,2.0,2.0,,2.0,1.0,,,1.0,1.0,,2016,39,30.74667,76.79424,145528.0,15050.0,8194.0
2016-11-14,Amla-Phyllanthus emblica,2.0,1.0,,2.0,1.0,,,2.0,1.0,,2016,41,30.74667,76.79424,145530.0,15050.0,8194.0
2016-11-21,Amla-Phyllanthus emblica,2.0,1.0,,2.0,1.0,,,2.0,1.0,,2016,41,30.74667,76.79424,145531.0,15050.0,8194.0
2016-11-28,Amla-Phyllanthus emblica,2.0,2.0,,2.0,1.0,,,2.0,2.0,,2016,42,30.74667,76.79424,145532.0,15050.0,8194.0
2016-12-05,Amla-Phyllanthus emblica,2.0,2.0,,1.0,0.0,,,2.0,2.0,,2016,43,30.74667,76.79424,145533.0,15050.0,8194.0
2016-04-15,Amla-Phyllanthus emblica,1.0,-1.0,,0.0,0.0,,,0.0,0.0,,2016,13,30.74667,76.79424,128227.0,15050.0,8194.0
2016-04-24,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,0.0,1.0,,2016,14,30.74667,76.79424,128682.0,15050.0,8194.0
2016-05-02,Amla-Phyllanthus emblica,1.0,2.0,,1.0,0.0,,,1.0,0.0,,2016,15,30.74667,76.79424,129415.0,15050.0,8194.0
2016-05-12,Amla-Phyllanthus emblica,1.0,2.0,,1.0,0.0,,,1.0,0.0,,2016,17,30.74667,76.79424,129416.0,15050.0,8194.0
2016-05-20,Amla-Phyllanthus emblica,2.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,18,30.74667,76.79424,130001.0,15050.0,8194.0
2016-05-04,Amla-Phyllanthus emblica,1.0,2.0,,0.0,1.0,,,1.0,0.0,,2016,16,30.74667,76.79424,128910.0,15050.0,8194.0
2016-05-06,Amla-Phyllanthus emblica,2.0,2.0,,1.0,0.0,,,1.0,1.0,,2016,16,30.74667,76.79424,129321.0,15050.0,8194.0
2016-02-05,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,0.0,1.0,,2016,4,30.74667,76.79424,121506.0,15050.0,8194.0
2016-02-12,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,0.0,1.0,,2016,5,30.74667,76.79424,122461.0,15050.0,8194.0
2016-03-16,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,1.0,2.0,,2016,9,30.74667,76.79424,126013.0,15050.0,8194.0
2016-04-01,Amla-Phyllanthus emblica,0.0,1.0,,0.0,0.0,,,0.0,1.0,,2016,11,30.74667,76.79424,127318.0,15050.0,8194.0
2016-04-08,Amla-Phyllanthus emblica,0.0,0.0,,0.0,0.0,,,0.0,0.0,,2016,12,30.74667,76.79424,127319.0,15050.0,8194.0
2016-03-07,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,1.0,2.0,,2016,8,30.74667,76.79424,126815.0,15050.0,8194.0
2016-03-25,Amla-Phyllanthus emblica,0.0,2.0,,0.0,0.0,,,0.0,2.0,,2016,10,30.74667,76.79424,126816.0,15050.0,8194.0
2016-02-26,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,1.0,1.0,,2016,7,30.74667,76.79424,124519.0,15050.0,8194.0
2016-02-19,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,0.0,2.0,,2016,6,30.74667,76.79424,123880.0,15050.0,8194.0
2016-03-11,Amla-Phyllanthus emblica,1.0,2.0,,0.0,0.0,,,0.0,2.0,,2016,9,30.74667,76.79424,125580.0,15050.0,8194.0
2022-08-24,Indian Laburnum-Cassia fistula,2.0,2.0,0.0,1.0,2.0,-2.0,-2.0,0.0,0.0,-2.0,2022,30,30.72778,76.77138,608079.0,24061.0,120375.0
2016-01-29,Indian Laburnum-Cassia fistula,0.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,3,30.71363,76.76623,120295.0,15048.0,8190.0
2016-01-28,Indian Laburnum-Cassia fistula,0.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,3,30.72968,76.77657,120232.0,15040.0,8180.0
2016-02-06,Indian Laburnum-Cassia fistula,1.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,4,30.71363,76.76623,121972.0,15048.0,8190.0
2019-06-15,Jackfruit-Artocarpus heterophyllus,2.0,1.0,0.0,-2.0,-2.0,1.0,0.0,1.0,-2.0,-2.0,2019,21,30.76238,76.76448,320558.0,20447.0,52819.0
2016-01-28,Jamun-Syzygium cumini,1.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,3,30.72768,76.77748,120235.0,15040.0,8182.0
2016-09-12,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,1.0,,,1.0,1.0,,2016,32,30.74667,76.79424,138253.0,15050.0,8369.0
2016-09-19,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,0.0,,,1.0,0.0,,2016,33,30.74667,76.79424,138254.0,15050.0,8369.0
2016-09-26,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,0.0,,,1.0,0.0,,2016,34,30.74667,76.79424,138255.0,15050.0,8369.0
2016-08-29,Mango (all varieties)-Mangifera indica,2.0,1.0,,0.0,1.0,,,1.0,0.0,,2016,31,30.74667,76.79424,138251.0,15050.0,8369.0
2016-09-05,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,0.0,,,0.0,0.0,,2016,32,30.74667,76.79424,138252.0,15050.0,8369.0
2016-01-28,Mango (all varieties)-Mangifera indica,1.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,3,30.70311,76.75958,120239.0,15042.0,8183.0
2016-10-03,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,0.0,,,0.0,0.0,,2016,35,30.74667,76.79424,140059.0,15050.0,8369.0
2016-10-10,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,0.0,,,1.0,1.0,,2016,36,30.74667,76.79424,140060.0,15050.0,8369.0
2016-10-17,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,0.0,,,1.0,1.0,,2016,37,30.74667,76.79424,140061.0,15050.0,8369.0
2016-11-28,Mango (all varieties)-Mangifera indica,1.0,2.0,,1.0,1.0,,,1.0,2.0,,2016,42,30.74667,76.79424,145525.0,15050.0,8369.0
2016-12-05,Mango (all varieties)-Mangifera indica,1.0,2.0,,1.0,1.0,,,1.0,1.0,,2016,43,30.74667,76.79424,145526.0,15050.0,8369.0
2016-11-21,Mango (all varieties)-Mangifera indica,2.0,2.0,,-1.0,1.0,,,1.0,0.0,,2016,41,30.74667,76.79424,145524.0,15050.0,8369.0
2016-10-24,Mango (all varieties)-Mangifera indica,0.0,2.0,,1.0,0.0,,,0.0,0.0,,2016,38,30.74667,76.79424,145520.0,15050.0,8369.0
2016-10-31,Mango (all varieties)-Mangifera indica,1.0,2.0,,1.0,0.0,,,1.0,0.0,,2016,39,30.74667,76.79424,145521.0,15050.0,8369.0
2016-11-14,Mango (all varieties)-Mangifera indica,1.0,2.0,,1.0,1.0,,,1.0,1.0,,2016,41,30.74667,76.79424,145523.0,15050.0,8369.0
2016-11-07,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,1.0,,,1.0,1.0,,2016,40,30.74667,76.79424,145522.0,15050.0,8369.0
2016-05-20,Mango (all varieties)-Mangifera indica,2.0,2.0,,2.0,1.0,,,2.0,1.0,,2016,18,30.74667,76.79424,130002.0,15050.0,8369.0
2016-04-15,Mango (all varieties)-Mangifera indica,2.0,2.0,,2.0,1.0,,,2.0,0.0,,2016,13,30.74667,76.79424,128228.0,15050.0,8369.0
2016-04-08,Mango (all varieties)-Mangifera indica,2.0,2.0,,2.0,0.0,,,0.0,0.0,,2016,12,30.74667,76.79424,127320.0,15050.0,8369.0
2016-05-02,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,0.0,,,2.0,1.0,,2016,15,30.74667,76.79424,129414.0,15050.0,8369.0
2016-05-06,Mango (all varieties)-Mangifera indica,2.0,1.0,,2.0,1.0,,,2.0,1.0,,2016,16,30.74667,76.79424,129320.0,15050.0,8369.0
2016-05-12,Mango (all varieties)-Mangifera indica,1.0,2.0,,1.0,0.0,,,2.0,1.0,,2016,17,30.74667,76.79424,129507.0,15050.0,8369.0
2016-04-25,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,0.0,,,2.0,1.0,,2016,14,30.74667,76.79424,128683.0,15050.0,8369.0
2016-07-11,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,1.0,,,2.0,2.0,,2016,24,30.74667,76.79424,135911.0,15050.0,8369.0
2016-07-25,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,1.0,,,2.0,2.0,,2016,26,30.74667,76.79424,135912.0,15050.0,8369.0
2016-08-01,Mango (all varieties)-Mangifera indica,2.0,2.0,,0.0,1.0,,,1.0,2.0,,2016,27,30.74667,76.79424,135913.0,15050.0,8369.0
2016-08-08,Mango (all varieties)-Mangifera indica,1.0,2.0,,1.0,1.0,,,1.0,2.0,,2016,28,30.74667,76.79424,135914.0,15050.0,8369.0
2016-08-15,Mango (all varieties)-Mangifera indica,1.0,2.0,,0.0,0.0,,,0.0,1.0,,2016,29,30.74667,76.79424,135915.0,15050.0,8369.0
2016-08-22,Mango (all varieties)-Mangifera indica,2.0,1.0,,1.0,1.0,,,1.0,1.0,,2016,30,30.74667,76.79424,135916.0,15050.0,8369.0
2016-07-04,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,0.0,,,2.0,2.0,,2016,23,30.74667,76.79424,135910.0,15050.0,8369.0
2016-07-18,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,1.0,,,2.0,2.0,,2016,25,30.74667,76.79424,135903.0,15050.0,8369.0
2016-05-27,Mango (all varieties)-Mangifera indica,1.0,2.0,,0.0,1.0,,,1.0,1.0,,2016,19,30.74667,76.79424,135892.0,15050.0,8369.0
2016-06-03,Mango (all varieties)-Mangifera indica,1.0,2.0,,2.0,2.0,,,2.0,1.0,,2016,19,30.74667,76.79424,135894.0,15050.0,8369.0
2016-06-10,Mango (all varieties)-Mangifera indica,1.0,2.0,,1.0,2.0,,,2.0,1.0,,2016,20,30.74667,76.79424,135896.0,15050.0,8369.0
2016-06-17,Mango (all varieties)-Mangifera indica,2.0,1.0,,2.0,2.0,,,2.0,1.0,,2016,21,30.74667,76.79424,135898.0,15050.0,8369.0
2016-06-24,Mango (all varieties)-Mangifera indica,2.0,2.0,,1.0,2.0,,,2.0,2.0,,2016,22,30.74667,76.79424,135900.0,15050.0,8369.0
2016-01-28,Neem-Azadirachta indica,0.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,3,30.72768,76.77748,120233.0,15040.0,8181.0
2016-01-29,Neem-Azadirachta indica,1.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,3,30.71406,76.76687,120298.0,15048.0,8191.0
2016-02-11,Pongam Tree-Pongamia pinnata,1.0,2.0,,1.0,0.0,,,0.0,0.0,,2016,5,30.70756,76.76695,122463.0,15049.0,8193.0
2016-01-19,Pongam Tree-Pongamia pinnata,1.0,2.0,,0.0,0.0,,,0.0,0.0,,2016,2,30.70756,76.76695,122464.0,15049.0,8192.0
2016-01-29,Pongam Tree-Pongamia pinnata,1.0,1.0,,0.0,0.0,,,0.0,0.0,,2016,3,30.70756,76.76695,120303.0,15049.0,8192.0
2022-08-24,Pride of India-Lagerstroemia speciosa,2.0,2.0,1.0,1.0,2.0,-2.0,-2.0,0.0,0.0,0.0,2022,30,30.73051,76.71466,608082.0,24061.0,120377.0
Observation_ID,Date_of_observation,User_id,User_Tree_id,Species_id,Species_name,Lat,Long,State_name,Leaves_fresh,Leaves_mature,Leaves_old,Flowers_bud,Flowers_open,Flowers_male,Flowers_Female,Fruits_unripe,Fruits_ripe,Fruits_open,Year,Week
608079.0,2022-08-24,24061.0,120375.0,1020,Indian Laburnum-Cassia fistula,30.72778,76.77138,Chandigarh,2.0,2.0,0.0,1.0,2.0,-2.0,-2.0,0.0,0.0,-2.0,2022,31
608082.0,2022-08-24,24061.0,120377.0,1045,Pride of India-Lagerstroemia speciosa,30.73051,76.71466,Chandigarh,2.0,2.0,1.0,1.0,2.0,-2.0,-2.0,0.0,0.0,0.0,2022,31
Loading

0 comments on commit 5adfcb6

Please sign in to comment.