July | 2016 | i hack on things

Caveats

use URI::Heuristic qw(uf_uri);
my $url = uf_uri('/etc/passwd');      # file:/etc/passwd

1 2	use URI::Heuristic qw(uf_uri); my $url = uf_uri('/etc/passwd'); # file:/etc/passwd

Are we sure this is what we want? Checking the scheme is helpful and even if we weren’t using this module, we’d probably want to do this anyway.

use List::AllUtils qw( any );
use URI::Heuristic qw(uf_uri);

my $url = uf_uri('/etc/passwd');
unless ( $url->scheme && any { $url->scheme eq $_ } ('http', 'https') ) {
    die 'unsupported scheme: ' . $url->scheme;
}

use List::AllUtils qw( any );

use URI::Heuristic qw(uf_uri);

my $url = uf_uri('/etc/passwd');

unless ( $url->scheme && any { $url->scheme eq $_ } ('http', 'https') ) {

die 'unsupported scheme: ' . $url->scheme;

}

That’s it! This module has been around for almost 18 years now, but it still solves some of today’s problems.

Every so often you find yourself requiring the download URL for a CPAN module. You can use the MetaCPAN API to do this quite easily, but depending on your use case, you may not be able to do this in a single query. Well, that’s actually not entirely true. Now that we have v1 of the MetaCPAN API deployed, you can test out the shiny new (experimental) download_url endpoint. This was an endpoint added by Clinton Gormley at the QA Hackathon in Berlin. Its primary purpose is to make it easy for an app like cpanm to figure out which archive to download when a module needs to be installed. ~~MetaCPAN::Client doesn’t support this new endpoint yet, but~~ if you want to take advantage of it, it’s pretty easy.

use strict;
use warnings;
use feature qw( say );

use Cpanel::JSON::XS qw( decode_json );
use LWP::UserAgent;
use URI::FromHash qw( uri );

my $module = shift @ARGV;

my $ua  = LWP::UserAgent->new;
my $uri = uri(
    scheme => 'https',
    host   => 'fastapi.metacpan.org',
    path   => '/v1/download_url/' . $module,
);

my $res = $ua->get($uri);
say decode_json( $res->decoded_content )->{download_url};

use strict;

use warnings;

use feature qw( say );

use Cpanel::JSON::XS qw( decode_json );

use LWP::UserAgent;

use URI::FromHash qw( uri );

my $module = shift @ARGV;

my $ua = LWP::UserAgent->new;

my $uri = uri(

scheme => 'https',

host => 'fastapi.metacpan.org',

path => '/v1/download_url/' . $module,

);

my $res = $ua->get($uri);

say decode_json( $res->decoded_content )->{download_url};

Now invoke your script:

olaf$ perl download_url.pl Plack https://cpan.metacpan.org/authors/id/M/MI/MIYAGAWA/Plack-1.0039.tar.gz

Update!

After I originally wrote this post, MICKEY stepped up and actually added the functionality to MetaCPAN::Client. A huge thank you to him for doing this. 🙂 Let’s try this again:

use strict;
use warnings;
use feature qw( say );

use MetaCPAN::Client 1.018000;
my $mcpan = MetaCPAN::Client->new( version => 'v1' );

my $module = shift @ARGV;

say $mcpan->download_url( $module )->download_url;

use strict;

use warnings;

use feature qw( say );

use MetaCPAN::Client 1.018000;

my $mcpan = MetaCPAN::Client->new( version => 'v1' );

my $module = shift @ARGV;

say $mcpan->download_url( $module )->download_url;

That cuts the lines of code almost in half and is less error prone than crafting the query ourselves. I’d encourage you to use MetaCPAN::Client unless you have a compelling reason not to.

Caveats

This endpoint is experimental. It might not do what you want in all cases. See this GitHub issue for reference. Please add to this issue if you find more cases which need to be addressed. Having said that, this endpoint should do the right thing for most cases. Feel free to play with it to see if it suits your needs.

Month: July 2016

Don’t Forget about URI::Heuristic

Caveats

How to Get a CPAN Module Download URL

Update!

Caveats