Extending gdal, pdal, ... builds with tiledb
Greetings,
As both a Debian'er and a TileDB employee, I had looked a few times into
packaging TileDB for Debian. The good news is that I currently have something
in my own informal PPA (see below) -- including rebuilds of the gdal and pdal
packages taken from ubuntugis-unstable.
Some related points:
1) AWS -- The TileDB build has a large number of optional components
important for some use cases. We particularly care about AWS use, which
requires the AWS SDK for C++ which is huge. One thing I did early on was a
set of "inofficial" packages of the AWS subset needed here (just a handful of
components) plus the three small other AWS libraries it needs. These are in
my github repo as well as PPA, and I used them for maybe 20 months in various
Docker containers and other Debian + Ubuntu uses. I recently sent mail to
debian-devel and Noah responded; maybe we get this AWS packaged with the
Debian Cloud team.
2) CapnProto -- The TileDB cloud extension also needs serialization for which
we use capnproto. We had pinned an older library for a while, but recently
upgraded it. The version now in Debian experimental works, but needs to be
available (so added to my ppa). That should only be a small hurdle, I have
not yet contacted the maintainer to see if / when this may migrate.
3) Builds -- The rest is pretty straightforward, at least in the builds I
have done (which still leave a number of CMake switches 'off'). Once built,
gdal and pdal also configure and build fine. (I think I had to comment one
gdal test out because it was hitting an API entry point removed in the
current TileDB 2.5.3 I used; and similarly disable a little bit of test code
in pdal. These changes are in my diffs.)
4) TileDB 1.7.7 in Debian -- There is a packaging attempt of a more minimal
TileDB configuration in unstable, with a number of build issues on other
platforms. We have since changed quite a few things in TileDB (i.e. no more
TBB) and had a number of releases. It may make sense to revive this, but when
I tried to contact Adam who did this I never heard back. Is anybody in
contact with him?
5) Other -- I emailed a little with Angelos on whose most excellent repo work
in the PPA a lot of other use cases (e.g. Michael's PPA with 5000 R packages
deployes ubunutugis-stable) rest, he promised to take a look time permitting.
My colleagues are currently only mildly interested as we have a number of
deployments on Ubuntu 20.04 containers. However, given that my colleagues are
more familiar with Conda esp for mac + windows use, we deploy conda binaries
on those so my endeavours have so far been clearly inofficial as far as
TileDB goes (but underpin some additional testing my TileDB R package gets).
Thanks for reading this far. If this of interest to anybody else please reach
out. We might be able to do something going forward given the existence
proof of these PPA builds (details below).
Cheers, Dirk
root@docker:~# dpkg -l | egrep "tiledb|pdal|gdal" | cut -c-80
ii gdal-bin 3.4.0+dfsg-1~focal2 amd64
ii gdal-data 3.4.0+dfsg-1~focal2 all
ii libgdal-dev 3.4.0+dfsg-1~focal2 amd64
ii libgdal30 3.4.0+dfsg-1~focal2 amd64
ii libpdal-base12 2.2.0+ds-1~focal6 amd64
ii libpdal-plugin-e57 2.2.0+ds-1~focal6 amd64
ii libpdal-plugin-faux 2.2.0+ds-1~focal6 amd64
ii libpdal-plugin-hdf 2.2.0+ds-1~focal6 amd64
ii libpdal-plugin-i3s 2.2.0+ds-1~focal6 amd64
ii libpdal-plugin-icebridge 2.2.0+ds-1~focal6 amd64
ii libpdal-plugin-pgpointcloud 2.2.0+ds-1~focal6 amd64
ii libpdal-plugin-tiledb 2.2.0+ds-1~focal6 amd64
ii libpdal-plugins 2.2.0+ds-1~focal6 amd64
ii libpdal-util12 2.2.0+ds-1~focal6 amd64
ii libtiledb-dev:amd64 2.5.3-1.2004.4 amd64
ii libtiledb2.5:amd64 2.5.3-1.2004.4 amd64
ii pdal 2.2.0+ds-1~focal6 amd64
ii python3-gdal 3.4.0+dfsg-1~focal2 amd64
root@docker:~#
root@docker:~# grep ^deb /etc/apt/sources.list.d/*list
/etc/apt/sources.list.d/edd-ubuntu-misc-focal.list:deb http://ppa.launchpad.net/edd/misc/ubuntu focal main
/etc/apt/sources.list.d/ubuntugis-ubuntu-ubuntugis-unstable-focal.list:deb http://ppa.launchpad.net/ubuntugis/ubuntugis-unstable/ubuntu focal main
root@docker:~#
--
https://dirk.eddelbuettel.com | @eddelbuettel | edd@debian.org
Reply to: