Bug#969803: awscli: autopkgtest should be marked superficial

[Sudip Mukherjee <sudipm.mukherjee@gmail.com>]

Hi Noah,

On Tue, Sep 8, 2020 at 5:48 PM Noah Meyerhans <noahm@debian.org> wrote:
>
> On Tue, Sep 08, 2020 at 10:38:18AM +0100, Sudip Mukherjee wrote:
> > The test done in the autopkgtest of 'awscli' does not provide
> > significant test coverage and it should be marked with "Restrictions:
> > superficial".
>
> The current test merely invokes "/usr/bin/aws help".  Is there any
> actual value in this test at all?  Should we just remove it?

I think you can keep it and mark it superficial. This will atleast
show you that it has built properly and is executing.

>
> Short of communicating with a remote service, I'm not sure how we can
> get more meaningful functional test coverage in this package, but it
> would be nice to do so.

There is also another "Restrictions: needs-internet" which might be
useful for you.
Please check https://sources.debian.org/data/main/a/autopkgtest/5.14/doc/README.package-tests.rst
which has a section for "Network access". That says:
"But for many packages their main purpose is to interact with remote
web services and thus their testing should actually cover those too,
to ensure that the distribution package keeps working with their
corresponding web service.".

Also, Paul might have some more suggestions.


-- 
Regards
Sudip