summaryrefslogtreecommitdiff
path: root/it_url.class
AgeCommit message (Collapse)AuthorFilesLines
2014-04-08optional error reporting for it_url::get failuresUrban Müller1-3/+7
2014-03-06keep original header, factor out header parsing code from request, do not ↵Nathan Gass1-6/+20
send request headers with value null
2014-02-19implement and test argument maxlength (for crawler)Nathan Gass1-2/+6
2014-02-17modernize user-agentDavid Flatz1-1/+1
2014-02-17don't get rid of common index file names in urls, we can't assume server ↵David Flatz1-3/+0
configurations
2013-11-01Remove $Id$Christian Schneider1-2/+0
2013-07-15fix absolute() for urs like /foo//barChristian Weber1-1/+1
2013-07-12shorter codeUrban Müller1-3/+1
2013-07-12only load it_text.class if no Accept-Language header is givenNathan Gass1-1/+3
2013-03-04factor out request method from get method, make http method overwritable, ↵Nathan Gass1-73/+89
fix Host header
2013-01-31declare functions staticUrban Müller1-4/+4
2012-12-03curl_multi_select can return -1 without select when polling is necessary ↵Nathan Gass1-19/+18
(see curl_multi_fdset doku)
2012-11-23debug last commitNathan Gass1-1/+1
2012-11-19make sure results are returned in the same order as input urls arrayNathan Gass1-3/+4
2012-11-19allow handler function per url which can abort in get_multiNathan Gass1-15/+23
2012-09-19Added work-around for cURL 7.25.0 problem with first select call hangingChristian Schneider1-1/+3
2012-08-30Added debug parameter reqtimings to time multiget subrequestsChristian Schneider1-2/+11
2012-08-14Handle errors (e.g. timeouts) in it_url::get_multi by returning false for ↵Christian Schneider1-3/+7
those urls
2012-03-20Fix getcache not updating processed file if another processed file updated ↵Christian Schneider1-7/+2
source in the meantime
2012-01-28honor "safety" param in it_url::get_cache_contentsUrban Müller1-1/+1
2011-12-09Added parameter $p["returnheaders"] => true to return array($path, $headers) ↵Christian Schneider1-2/+12
for url instead of only $path
2011-10-25adapt styleNathan Gass1-4/+5
2011-10-25replace busy curl_multi loop by correct curl_multi loop from php dokuNathan Gass1-2/+13
2011-09-27fall back on get_multi for other protocolsNathan Gass1-0/+6
2011-09-08Enforce parameter of it_url::redirect to be either 'permanent' or 'temporary'Christian Schneider1-2/+5
2011-09-08add support for permanent redirect, change default/temporary redirect from ↵Christian Helbling1-6/+6
302 to 303 which is what is usually meant and is the (incorrect) behaviour of most clients on a 302
2011-06-15get_cache_contents, default directoryUrban Müller1-1/+10
2011-06-15added custom headers to get_multiChristian Helbling1-0/+8
2011-05-24add it_url::get_multi to fetch multiple urls in parallelNathan Gass1-0/+45
2011-03-01Handle keepfailed when blocked process discovers that file could not be fetchedChristian Schneider1-2/+9
2011-02-25Also consider HTTP headers when calculating cache filename and document ↵Christian Schneider1-1/+2
headers parameter for get_cache()
2010-07-14fix keepfailed modeUrban Müller1-1/+3
2010-06-14add backtrace to suppressed redirectUrban Müller1-1/+1
2010-06-05document header param of it_url::get()Christian Weber1-0/+1
2010-06-02it_url::get() no longer creates new objects if not called statically. Added ↵Christian Weber1-4/+8
it_url::get() test cases
2010-03-10better err msg if url emptyUrban Müller1-1/+1
2010-01-27do one retry by defaultUrban Müller1-2/+9
2010-01-07Upgrade subrequests to MSIE 7 to avoid pngfixChristian Schneider1-1/+1
2009-09-14alert noncreateable var/urlcacheUrban Müller1-0/+3
2009-08-14Close a lock race when lock expires, check existance of file in _waitforlockChristian Schneider1-14/+11
2009-08-12Do not add port 443 in HTTPS modeChristian Schneider1-1/+1
2009-08-10Support ports othen than port 80, output full url in noredir modeChristian Schneider1-5/+4
2009-07-31New version of get_cache (using If-Not-Modified-Since support in get)Christian Schneider1-83/+129
2009-06-24Enhanced documentationChristian Schneider1-1/+3
2009-06-24Added new parameter 'id' to specify cache typeChristian Schneider1-7/+4
2009-06-24Added get_cache_dir with support for paths relative to /var/urlcacheChristian Schneider1-8/+24
2009-05-19bugfix: only adapt processed stamps if there was any processingUrban Müller1-5/+6
2009-04-22Get rid of ereg/split, replaced by preg equivalentsChristian Schneider1-15/+15
2008-10-15phplint cleanupUrban Müller1-2/+2
2008-06-27Do not trigger class loader for Net_IDNA, has to be manually includedChristian Schneider1-1/+1
generated by cgit v1.2.3 (git 2.25.1) at 2024-12-28 19:48:56 +0000