-
Notifications
You must be signed in to change notification settings - Fork 7
/
Copy pathCHANGES.txt
344 lines (283 loc) · 10.6 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
Changes
=======
0.15.0 (2024-12-20)
------------------
- use some other tool for reprojection - always request data in BC Albers and remove options for reprojection (#210)
0.14.0 (2024-12-17)
------------------
- simplify WFS module, standardize cat/dump options
0.13.0 (2024-12-11)
------------------
- support Data Catalogue API changes (#188)
- bump dependencies
- default to slightly cleaning/standardizing features returned from bcdata.get_data() / bcdata dump
0.12.3 (2024-11-12)
------------------
- ensure --geometry_type option is used correctly (#198)
- handle WHSE_ADMIN_BOUNDARIES.ADM_NR_DISTRICTS_SPG/WHSE_ADMIN_BOUNDARIES.ADM_NR_DISTRICTS_SP (#200)
0.12.2 (2024-08-15)
------------------
- fix error where incorrect schema returned for datasets with multiple resources (#196)
0.12.1 (2024-08-15)
------------------
- fix syntax error
0.12.0 (2024-08-15)
------------------
- expose primary key database as bcdata.primary_keys and via bcdata info (#193)
0.11.0 (2024-07-29)
------------------
- upgrade dependencies
- note bcgov uptime monitor in readme
0.10.4 (2024-06-28)
------------------
- bc2pg - enable --no_timestamp on --refresh
0.10.3 (2024-06-28)
------------------
- bc2pg - fix logging error on data refresh (#184)
- fix failures on specific tables due to API quirks (#179/#181)
- bc2pg - add missing --bounds option (#173)
0.10.2 (2024-03-01)
------------------
- improve connection management for better stability (#171)
0.10.1 (2024-02-19)
------------------
- check that table to be refreshed exists when using bc2pg --refresh (#167)
0.10.0 (2024-02-19)
------------------
- store known primary keys in repository (data/primary_keys.json)
- add new function bcdata.get_primary_keys(), using remote url as default primary key lookup for bc2pg (#163)
- when available, use known primary key as default sortkey (#165)
- enable bcdata.get_sorkey() function
- draft bc2pg --refresh option now available only via CLI
0.9.2 (2024-02-18)
------------------
- bc2pg geometry type inspection - look for geometries at bottom of dataset when none present at top (#158)
- add refresh option to bc2pg command, truncating existing table (#160)
0.9.1 (2023-12-30)
------------------
- fix problem with multiple-resource bcdc packages (#153)
0.9.0 (2023-11-17)
------------------
- use default pagesize provided by server and remove pagesize option from all functions and commands (#90)
- restore dynamic layer listing (#142)
- better error reporting when service unavailable (#143)
- include data description in `bcdata info` output (#148)
- standardize and test retries with `stamina`
0.8.1post1 (2023-08-21)
------------------
- update requirements.txt/environment.yml and pin dependencies
0.8.1 (2023-08-21)
------------------
- remove redundant request from bc2pg, drop wfs get_spatial_types function
- get sort key and geom column via DescribeFeatureType request (via owslib.feature.schema) rather than GetCapabilities
- list tables internally as a temporary work around for missing getCapabilities response from service (#141)
0.8.0 (2023-07-21)
------------------
All changes from pre-releases below
0.8.0b1 (2023-07-13)
------------------
- wrap all requests to WFS/BCDC with @retry to better handle network/service errors
- modify cache structure, bcdata now caches to folder ~/.bcdata/
- cache layer schemas to reduce request load
- refactor wfs module to better handle caching/retrys
0.8.0a3 (2023-07-05)
------------------
- improve retry logic on download error, further request minimization, fix bcdc regression from #135
0.8.0a2 (2023-07-03)
------------------
- handle tables with schema stored in bcdc resource with format='multiple' (#135)
0.8.0a1 (2023-06-29)
------------------
- cache WFS GetCapabilities response for faster requests and fewer http errors
- retry bc2pg requests on failure
- move bc2pg download logging to bcdata.log
- fix dem command default output CRS (#125)
- upgrade to sqlalchemy v2 (#124)
- single threaded downloads only (--max_workers option removed)
0.7.12 (2023-06-28)
------------------
- fix bc2pg cli error
0.7.11 (2023-06-28)
------------------
- fix conflicting bc2pg short option definitions (#134)
0.7.10 (2023-06-28)
------------------
- add bc2pg option --geometry_type to avoid issues when type sniffing (#132)
- fix appending to table with name different from source (#133)
0.7.9 (2023-06-13)
------------------
- fix geometry type checking (#131)
- update geopandas requirement (#129)
0.7.8 (2023-06-01)
------------------
- pin geopandas requirement to <v0.13 (#129)
0.7.7 (2023-04-13)
------------------
- add option to lowercasify properties keys / column names (#126)
0.7.6 (2023-02-01)
------------------
- better handling of connection errors (#118)
- correctly handle empty geodataframes (#121)
- pin sqlalchemy to <2.0 (#124)
0.7.4 (2022-09-28)
------------------
- bc2pg - option --no_timestamp now recognized (#116)
- bc2pg - preserve floating point data (#117)
0.7.3 (2022-09-26)
------------------
- bc2pg - fully handle geometries with Z values (#114) and add a test to check
0.7.2 (2022-09-26)
------------------
- bc2pg - handle geometries with Z values (#114)
0.7.1 (2022-09-26)
------------------
- bc2pg - add missing --sortby option
- bc2pg - better --append checks
0.7.0 (2022-07-18)
------------------
- bcdata.define_request function renamed to define_requests, returns list of
parsed urls rather than a list of request parameter dictionaries - this makes
it easy to interactively generate request urls for geopandas/debugging/other
- new bc2pg Python module/function
+ general purpose loading tool
+ output table column types and comments are as specified in BC Data
Catalogue API
+ data loads are via sqlalchemy/geopandas
+ schema_only option included for creation of empty tables
+ all features are promoted to multipart
+ BC Albers only, no re-projection support
- updated bc2pg command line tool
+ uses new bc2pg Python function (no longer an ogr2ogr wrapper)
+ fid option renamed to primary_key
+ new option --schema_only
+ options removed: bounds,bounds_crs,max_workers,dim,promote_to_multi,makevalid
- added a count option to most functions/commands for downloading only n records
0.6.3 (2022-06-08)
------------------
- add --max_workers option to bcdata cat
- improve logging with bcdata cat
0.6.2 (2022-06-08)
------------------
- fix bc2pg append mode and primary key handling (#104)
- bc2pg --append now requires --fid
- add bc2pg tests (#43)
- require local test database for running tests
0.6.1 (2022-04-26)
------------------
- enable configuration of cache file location via $BCDATA_CACHE environment variable (#99)
0.6.0 (2022-04-26)
------------------
- dem - add option to align downloaded tiff to BC default (#97)
- remove bcgw object name shell completion (#98)
0.5.1 (2021-11-25)
------------------
- bc2pg - remove non-functional option to specify geom type on load, revert to --promote_to_multi (#92)
0.5.0 (2021-11-25)
------------------
- bc2pg - add option to validate on load (#91)
- bc2pg - add option to specify geometry type on load (#92)
- bump click version requirement (#94)
0.4.5 (2021-04-06)
------------------
- fix outdated setup.py (#88)
0.4.4 (2021-04-03)
------------------
- track most recent date a table is downloaded to postgres via bc2pg with `public.bcdata` (#86)
- cleanup temp tables on bail (#73)
- remove pgdata dependency and use psycopg2 built in string methods (#87)
0.4.3 (2020-11-10)
------------------
- make dataset name arguments case insensitive
- default max_workers to 2 in functions outside of CLI
- bc2pg - add option --promote_to_multi to invoke ogr2ogr's -nlt PROMOTE_TO_MULTI and support
layers with mixed single/multipart types
- add optional crs object to geojson output of bcdata.get_data() (#82)
0.4.2 (2020-08-26)
------------------
- bc2pg - fix bug that populated incorrect primary key values for multi-page requests (#78)
- bc2pg - for large requests, default max_workers to 2 rather than 5 (#75)
0.4.1 (2020-02-28)
------------------
- fix bc2pg connection string (#74)
0.4.0 (2020-02-27)
------------------
- WxS requests made via https (#59)
- add options --verbose / --quiet to CLI (#62)
- add option --interpolation to dem command (#63)
- add option as_gdf to get_data function to load directly to a geopandas
dataframe (#67)
- fix bc2pg to actually use port specified in --db_url (#69)
- regenerate data list cache daily (#70)
- fix bc2pg to only use a password when provided in --db_url (#72)
0.3.5 (2019-10-08)
------------------
- use http WFS requests to avoid certificate errors (#59)
- fix bug introduced in v0.3.4 (#60)
0.3.4 (2019-09-30)
------------------
- support using --bounds and --filter at the same time (#58)
- support --bounds_crs option for most tools/functions
- rename --src_crs option for dem command to --bounds_crs
0.3.3 (2019-05-16)
------------------
- use OBJECTID as default sortby key (#57)
- bc2pg - add dim option to support loading data with Z dimensions
- bc2pg - add fid option to enable correct assignment of primary key
- bc2pg - remove sortby option
- fix get_dem to use CRS parameters correctly (#53)
- bug fixes
0.3.2 (2019-03-22)
------------------
- add append option to bc2pg
- fix bcdata cat not requesting specified CRS (#48)
- fix crash when DATABASE_URL not set (#49)
- handle WCS request errors
0.3.1 (2019-01-28)
------------------
- fix #45
- add progress bar
- enable bc2pg pagesize
0.3.0 (2019-01-04)
------------------
Major revision, nothing is backwards compatible
- download data via WFS rather than DWDS
- functions renamed
- data downloaded to file is to geojson only
- added `bc2pg` command for mirroring BC table in postgres
0.2.0 (2018-01-22)
------------------
- use DataBC Catalogue API to find data (#25, #31)
0.1.0.post1 (2018-01-17)
------------------
- fix typo in README
0.1.0 (2018-01-17)
------------------
- upload release to PyPI
- add continuous integration testing
- simplify file structure
- add info function/option (#30)
- require html5lib (#29)
- add path option to download function (#28)
- set default timeout 2hrs (#27, #26)
- Python 3 compatible, test with tox (#23)
- fix test (#21)
0.0.5 (2016-10-18)
------------------
- remove selenium and phantomjs dependencies
- geomark support removed
- CRS support removed
0.0.4 (2016-07-08)
------------------
- headless downloads! (#1)
- cli testing now functional (#3)
0.0.3 (2016-07-08)
------------------
- use a better key to find download link on catalog page (#15)
0.0.2 (2016-07-06)
------------------
- close issues related to layers / projections / appending (#2, #9, #10)
- cleanup
- fix problems with CLI
0.0.1 (2016-07-03)
------------------
Automation of simple downloads from British Columbia's Data Distribution Service.