Bug#1055284: preliminary research

[Antoine Beaupré <anarcat@debian.org>]

I started working on a Docker container for this, based on a Debian
container. To simplify the install (e.g. not require rebuilding lxml), I
pre-install a bunch of Debian packages for Python dependencies, but a
*lot* are missing.

The following are present:

    python3-bs4 \
    python3-dateutil \
    python3-dnspython \
    python3-geoip2 \
    python3-ipy \
    python3-lxml \
    python3-maxminddb \
    python3-phonenumbers \
    python3-pip \
    python3-psycopg2 \
    python3-pyasn \
    python3-pygments \
    python3-tz \
    python3-requests \
    python3-selenium \
    python3-setproctitle \
    python3-simplejson \
    python3-telethon \
    python3-virustotal-api \

But the following are not:

        "OTXv2",
        "PyGitHub>=1.55",
        "archiveis",
        "censys==2.2.0",
        "consolemd==0.5.1",
        "fullcontact.py",
        "greynoise>=1.2.0",
        "passivetotal>=2.5.9",
        "pybinaryedge==0.5",
        "pycrtsh==0.3.11",
        "pyhashlookup==1.2.1",
        "pyhunter",
        "pymisp==2.4.159",
        "pypdns==1.3",
        "pypermacc==0.1.1",
        "pysafebrowsing==0.1.2",
        "pysecuritytrails==0.1.3",
        "pythreatgrid2==0.1.1",
        "shodan",
        "spyonweb==0.1",
        "threatminer==1.0",
        "tweepy>=3.8.0",
        "zetalytics-api==1.0.1",

The following are available in Debian, but somehow pinned or declared in
a way that makes pip still install them

        "beautifulsoup4==4.11.1",
        "configparser",
        "lxml==4.9.2",
        "phonenumbers==8.12.4",
        "simplejson==3.17.6"
        "telethon==0.19.1.6",

So if we actually want everything in harpoon to actually work, there is
a *lot* of work to package dependencies here.

-- 
You can't get to the moon by climbing successively taller trees.
                        - Akin's Laws of Spacecraft Design