summaryrefslogtreecommitdiff
path: root/it_url.class
AgeCommit message (Collapse)AuthorFilesLines
22 hoursavoid false pos on localsearch.ch (mail6193)HEADmasterUrban Müller1-1/+1
8 daysReenable connection reuse since performance hit is too big; expose option to ↵David Flatz1-1/+2
force a fresh connection instead so that affected forking scripts can work around the problem that open connections from parent get closed by exiting children
10 daysdisable connection reuse as it leads to problems with search_mt.classNathan Gass1-0/+1
2025-08-13only get new urls from iterator after retries so they do not get stalled for ↵Nathan Gass1-13/+16
ever in a large get_multi
2025-08-13improve 8b65a2b2426fd04d46c943c76af40347a611bcee, only sleep if there are no ↵Nathan Gass1-2/+2
active handles
2025-08-13Remove obsolete (and starting from PHP 8.5 deprecated) ↵Christian Schneider1-1/+0
curl_close/xml_parser_free which has been handled by object GC since 8.0
2025-07-25changing get_cache to assoc must invalidate cacheUrban Müller1-1/+1
2025-07-09Document user and pass parametersDavid Flatz1-0/+2
2025-07-09Show first 2kb of response body when debugparameter curlinfo is setDavid Flatz1-1/+1
2025-07-08Use float to store maxage in minutes as we have maxage < 60 and want to ↵Christian Schneider1-1/+1
avoid 0, 'find' works with floats too
2025-07-07Store urlcache directoy maxage (in minutes) in 'cleaned' file for daily ↵Christian Schneider1-1/+1
cleanup job
2025-05-23remove fixme, CURLOPT_MAXFILESIZE looks at downloaded size and not ↵Nathan Gass1-2/+0
decompressed size
2025-02-18Cleanup round to make indentation style consistent across filesChristian Schneider1-1/+1
2025-02-08Truncate overly long referers leading to failed subrequest but make sure it ↵Christian Schneider1-1/+1
is still propery urlencoded (mail5960)
2024-12-02Revert "use CURLOPT_MAXFILESIZE now that we have current curl"Christian Schneider1-6/+18
This reverts commit 1c657c2264c17dc2980bbce2f63ddad7546e96d5.
2024-10-22port some more of the error handling from it_url::get to it_url::get_multiNathan Gass1-3/+6
2024-10-21use CURLOPT_MAXFILESIZE now that we have current curlNathan Gass1-18/+6
2024-07-10Work around idn_to_ascii not allowing empty string in PHP 8.4 by using ↵Christian Schneider1-1/+1
non-empty but falsey string
2024-07-04introduce ->status for ->result, temporarily support ->resultUrban Müller1-14/+15
2024-07-03make retries => 0 consistent with retries => 1: no it::error on 404Urban Müller1-5/+9
2024-07-01Remove special case for stale locks since those never occuredDavid Flatz1-12/+5
2024-06-27add response body to errors, rename $got to $bodyUrban Müller1-9/+10
2024-06-13keep http default for now, only http is guaranteed to work everywhereUrban Müller1-1/+1
2024-06-11remove http: useUrban Müller1-1/+1
2024-06-10http: -> https:Urban Müller1-3/+3
2024-05-27Fix it_url::get with maxlength and large responseChristian Schneider1-1/+1
2024-05-21more meaningful error message in title than 0 No ErrorNathan Gass1-2/+2
2024-05-16bugfix, thx buddhaUrban Müller1-1/+1
2024-05-16reduce quoting hellUrban Müller1-1/+1
2024-05-16securityUrban Müller1-1/+1
2024-05-08Switch default for it_url::get*() to not return body on status >= 400Christian Schneider1-6/+2
2024-05-07Show error string containing http status in alertsChristian Schneider1-1/+1
2024-05-07Fix documentation: Assoc now always returns array with statusChristian Schneider1-1/+1
2024-05-02Do not check body_on_fail with assoc mode, we looked at those separatelyChristian Schneider1-1/+1
2024-05-02Reenable warnings about behaviour change when switching body_on_fail defaultChristian Schneider1-2/+2
2024-05-02Rename empty_on_fail to body_on_fail for future switching of default, ↵Christian Schneider1-5/+5
currently also supports empty_on_fail for transition
2024-04-30fix typoUrban Müller1-2/+2
2024-04-30reorganize documentation for it_url::getUrban Müller1-13/+19
2024-04-30Only delete cache files (not directories) to avoid race with directory creationChristian Schneider1-1/+1
2024-04-30Fix is_reachable fetching always twice if content longer than 1000 bytes, ↵Christian Schneider1-8/+10
make retry test having to retry more often to test that code path
2024-04-29Also cache 404 in assoc case to keep previous behaviour, server errors >= ↵Christian Schneider1-1/+1
500 are not cached
2024-04-29Version 2 of: Switch it_url::get('assoc' => true) to always return non-empty ↵Christian Schneider1-3/+4
array including at least the HTTP status code
2024-04-25Revert "Switch it_url::get('assoc' => true) to always return non-empty array ↵Christian Schneider1-3/+2
including at least the HTTP status code" This reverts commit d4bd73f98063ebbdf6c6f5ce94252360de901c9a.
2024-04-24Switch it_url::get('assoc' => true) to always return non-empty array ↵Christian Schneider1-2/+3
including at least the HTTP status code
2024-04-24Disable reporting of empty_on_fail infosChristian Schneider1-3/+3
2024-04-22Send notice to schneider@search.ch to check where chaning default to ↵Christian Schneider1-0/+4
empty_on_fail=true would have an impact
2024-04-18introduce empty_on_fail, get keepfailed to workUrban Müller1-9/+10
2024-04-02remove last remnants of failed utest modeUrban Müller1-3/+0
2023-11-14previous commit changed error code for maxlength reachedNathan Gass1-1/+1
2023-11-13Revert "simplify maxlength implementation and make compatible with ↵Nathan Gass1-4/+13
writefunction" This reverts commit f75da376ff31eed20e409797260ba832be3b9308.
generated by cgit v1.2.3 (git 2.25.1) at 2025-09-19 18:47:40 +0000