PHP library to get information from any web page (using oembed, opengraph, twitter-cards, scrapping the html, etc). It's compatible with any web service (youtube, vimeo, flickr, instagram, etc) and has adapters to some sites like (archive.org, github, facebook, etc).
Requirements:
- PHP 5.5+
- Curl library installed
- If you need PHP 5.3 support, use the 1.x version
- If you need PHP 5.4 support, use the 2.x version
http://oscarotero.com/embed3/demo
This package is installable and autoloadable via Composer as embed/embed.
$ composer require embed/embed
If you cannot (or don't want to) use composer, just include the PSR-4 autoload.php file in your code.
use Embed\Embed;
//Load any url:
$info = Embed::create('https://www.youtube.com/watch?v=PP1xn5wHtxE');
//Get content info
$info->title; //The page title
$info->description; //The page description
$info->url; //The canonical url
$info->type; //The page type (link, video, image, rich)
$info->tags; //The page keywords (tags)
$info->images; //List of all images found in the page
$info->image; //The image choosen as main image
$info->imageWidth; //The width of the main image
$info->imageHeight; //The height of the main image
$info->code; //The code to embed the image, video, etc
$info->width; //The width of the embed code
$info->height; //The height of the embed code
$info->aspectRatio; //The aspect ratio (width/height)
$info->authorName; //The resource author
$info->authorUrl; //The author url
$info->providerName; //The provider name of the page (Youtube, Twitter, Instagram, etc)
$info->providerUrl; //The provider url
$info->providerIcons; //All provider icons found in the page
$info->providerIcon; //The icon choosen as main icon
$info->publishedDate; //The published date of the resource
$info->license; //The license url of the resource
$info->linkedData; //The linked-data info (http://json-ld.org/)
$info->feeds; //The RSS/Atom feeds
The adapter is the class that get all information of the page from the providers and choose the best result for each value. For example, a page can provide multiple titles from opengraph, twitter cards, oembed, the <title>
html element, etc, so the adapter get all this titles and choose the best one.
Embed has an generic adapter called "Webpage" to use with any web but has also some specific adapters for sites like archive.org, facebook, google, github, spotify, etc, that provides information using their own apis, or need to fix any specific issue.
The available options for the adapters are:
Name | Type | Description |
---|---|---|
min_image_width |
int |
Minimal image width used to choose the main image |
min_image_height |
int |
Minimal image height used to choose the main image |
choose_bigger_image |
bool |
Choose the bigger image as the main image (instead the first found, that usually is the most relevant). |
images_blacklist |
string |array |
Images that you don't want to be used. Could be plain text or Uri match pattern. |
url_blacklist |
string |array |
URLs that you don't want to be used. Could be plain text or Uri match pattern. |
follow_canonical |
bool |
Whether to redirect to the canonical URL or not. |
custom_adapters_namespace |
string |array |
A namespace used to load custom adapters. This allows to override the behaviour of existing adapters or add support for more sites. |
The providers get the data from different sources. Each source has it's own provider. For example, there is a provider for opengraph, other for twitter cards, for oembed, html, etc. Some providers can be configured and are the following:
Used to get data from oembed api if it's available:
Name | Type | Description |
---|---|---|
parameters |
array |
Extra query parameters to send with the oembed request |
embedly_key |
string |
If it's defined, use embed.ly api as fallback oembed provider. |
iframely_key |
string |
If it's defined, use iframe.ly api as fallback oembed provider. |
Used to get data directly from the html code of the page:
Name | Type | Description |
---|---|---|
max_images |
int |
Max number of images fetched from the html code (searching for the <img> elements). By default is -1 (no limit). Use 0 to no get images. |
external_images |
bool |array |
By default is false , this means that images located in other domains are not allowed. You can set true (allow all) or provide an array of url patterns. |
Used only for google maps to generate the embed code.
Name | Type | Description |
---|---|---|
key |
string |
The key used for the embed api |
Used only for soundcloud pages, to get information using its api.
Name | Type | Description |
---|---|---|
key |
string |
The key used to get info from soundcloud API. |
Used only for facebook events (not needed for posts, images, etc), to get information using its api.
Name | Type | Description |
---|---|---|
key |
string |
The access token used to get info from facebook graph API. |
events_fields |
string |
Comma-separated list of fields to query for a facebook event. Please refer to Facebook documentation for the full list of available fields. |
videos_fields |
string |
Comma-separated list of fields to query for a facebook video. Please refer to Facebook documentation for the full list of available fields. |
The options are passed as the second argument as you can see in the following example:
$info = Embed::create($url, [
'min_image_width' => 100,
'min_image_height' => 100,
'choose_bigger_image' => true,
'images_blacklist' => 'example.com/*',
'url_blacklist' => 'example.com/*',
'follow_canonical' => true,
'html' => [
'max_images' => 10,
'external_images' => true
],
'oembed' => [
'parameters' => [],
'embedly_key' => 'YOUR_KEY',
'iframely_key' => 'YOUR_KEY',
],
'google' => [
'key' => 'YOUR_KEY',
],
'soundcloud' => [
'key' => 'YOUR_KEY',
],
'facebook' => [
'key' => 'YOUR_KEY',
'fields' => 'field1,field2,field3' // default : cover,description,end_time,id,name,owner,place,start_time,timezone
],
]);
To dispatch the http request, Embed includes the interface Embed\Http\DispatcherInterface
. By default the curl library is used but you can create your own dispatcher to use any other library like guzzle:
use Embed\Embed;
use Embed\Http\DispatcherInteface;
use Embed\Http\Url;
use Embed\Http\Response;
use Embed\Http\ImageResponse;
class MyDispatcher implements DispatcherInterface
{
public function dispatch(Url $url)
{
$result = function_to_execute_request($url);
return new Response($url, $result['url'], $result['status'], $result['type'], $result['content'], $result['headers']);
}
public function dispatchImages(array $urls)
{
$responses = [];
foreach ($urls as $url) {
$result = function_to_get_image_size($url);
if ($result) {
$responses[] = new ImageResponse($url, $result['url'], $result['status'], $result['type'], $result['size'], $result['headers']);
}
}
return $responses;
}
}
//Use the dispatcher passing as third argument
$info = Embed::create('http://example.com', null, new MyDispatcher());
The default curl dispatcher accepts the same options that the curl_setopt PHP function. You can edit the default values:
use Embed\Embed;
use Embed\Http\CurlDispatcher;
$dispatcher = new CurlDispatcher([
CURLOPT_MAXREDIRS => 20,
CURLOPT_CONNECTTIMEOUT => 10,
CURLOPT_TIMEOUT => 10,
CURLOPT_SSL_VERIFYPEER => false,
CURLOPT_SSL_VERIFYHOST => false,
CURLOPT_ENCODING => '',
CURLOPT_AUTOREFERER => true,
CURLOPT_USERAGENT => 'Embed PHP Library',
CURLOPT_IPRESOLVE => CURL_IPRESOLVE_V4,
]);
$info = Embed::create('http://example.com', null, $dispatcher);
The adapter get the data from all providers and choose the best values. But you can get all available values accessing directly to each provider. There's also the possibility to inspect all http requests executed for debug purposes:
use Embed\Embed;
//Get the info
$info = Embed::create('https://www.youtube.com/watch?v=PP1xn5wHtxE');
//Get all providers
$providers = $info->getProviders();
//Get the oembed provider
$oembed = $providers['oembed'];
//Get the oembed title value:
echo $oembed->getTitle();
//Get any value returned by the oembed api
echo $oembed->bag->get('author_name');
//Get the main response object
$response = $info->getResponse();
//Get any http response header
$lastModified = $response->getHeader('Last-Modifier');
//Get the html body as DOMDocument
$html = $response->getHtmlContent();
//Get all http request executed (oembed endpoints, images, apis, etc...)
$dispatcher = $adapter->getDispatcher();
foreach ($dispatcher->getAllResponses() as $response) {
echo 'The request to '.$response->getStartingUrl();
echo ' is resolved to '.$response->getUrl();
}
If this library is useful for you, say thanks buying me a beer ๐บ!