Mikael Nordfeldth
3bc2454e91
Avoid excessive remote requests on oEmbed lookups
...
I noticed that each time a notice was accessed it'd do a remote lookup
with HEAD (and continue despite 404 etc.) and then another attempt to
download the resource. If this wasn't successful new attempts would be
made for each loading of the resource, which is extremely resource
intensive.
Whenever we can say "it's been n seconds since the last attempt" we
could probably enable this again - or just manually reload remote
thumbnails (as part of the StoreRemoteMedia plugin etc.)
2017-07-10 14:41:03 +02:00
Mikael Nordfeldth
a7df79ac07
Force arrays in constructors of ActivityStreamJSONDocument and JSONActivityCollection
...
Started using PHP7+ and it started complaining about count() being fed objects
that weren't "Countable". .)
2017-07-10 14:26:01 +02:00
Mikael Nordfeldth
31866be98b
Use intval on ini_get or we use a string for timeout
2017-07-10 14:10:32 +02:00
Mikael Nordfeldth
57e22d78e0
Patch DB before release, weird use of count()
2017-07-10 14:10:10 +02:00
Mikael Nordfeldth
a4a6a8469e
Updating HTMLPurifier to 4.9.3
...
Source: https://htmlpurifier.org/download
Release date: 2017-06-19
2017-07-10 13:46:07 +02:00
Mikael Nordfeldth
3158f9c33a
Update PEAR DB to 1.9.2
...
Source: https://pear.php.net/package/DB
Release date: 2015-11-24
2017-07-10 13:34:47 +02:00
Mikael Nordfeldth
711f220397
Updating PEAR Net_URL2 to 2.1.2
...
Source: https://pear.php.net/package/Net_URL2
Release date: 2016-04-18
2017-07-10 13:29:31 +02:00
Mikael Nordfeldth
a223273544
Update PEAR DB_DataObject to 1.11.5
...
Source: https://pear.php.net/package/DB_DataObject
Release date: 2015-11-10
2017-07-10 13:25:04 +02:00
Mikael Nordfeldth
61876ed232
PEAR Net_SMTP updated to 1.8.0
...
Source: https://pear.php.net/package/Net_SMTP
Release date: 2017-04-06
2017-07-10 12:53:13 +02:00
Mikael Nordfeldth
f025671b8a
PEAR Net_Socket updated to 1.2.2
...
Source: https://pear.php.net/package/Net_Socket
Release date: 2017-04-13
2017-07-09 23:09:03 +02:00
Mikael Nordfeldth
489099ca91
change default timeout setting for HTTPClient
2017-07-09 22:49:49 +02:00
Mikael Nordfeldth
08b4b73c67
Updating HTTP_Request2 to 2.3.0
...
Source: https://pear.php.net/package/HTTP_Request2
Release date: 2016-02-13 15:24 UTC
2017-07-09 22:17:52 +02:00
Mikael Nordfeldth
fb492d4bb2
Remove debug call and change how connect_timeout is set
2017-07-09 20:34:44 +02:00
Mikael Nordfeldth
f0480c34d7
Configure a default timeout for HTTP connections at 60s
...
No requests we do externally should ever take more than 60 seconds. This
could probably be changed for downloading video or whatever for any cache
plugins that want to store data locally, but in general I think even 60s
is way longer than I expect any outgoing requests should take.
This affects everything using HTTPClient, our helper class, and thus all
hub pings, subscription requests, etc. etc.
The value, afaik, includes connect_timeout and if it takes 10 seconds to
establish a connection only 50 seconds is available to transfer data.
2017-07-09 20:28:22 +02:00
Mikael Nordfeldth
3395f6081c
Endless loop nesting on ensureHub failure now fixed
...
Essentially I was missing a negation on a test if we were in rediscovery mode.
2017-06-22 14:37:32 +02:00
Mikael Nordfeldth
c9a9a8bc58
Fulltext indexes are supported in InnoDB since MariaDB 10.0.15
2017-06-22 01:37:43 +02:00
Mikael Nordfeldth
fa44e0c06e
set a 'rediscovered' parameter to avoid nesting into an ensureHub loop forever
2017-06-22 00:30:38 +02:00
Mikael Nordfeldth
5265c48d04
GNU social avatar by moshpirit / Alberto
2017-05-30 21:37:53 +02:00
Mikael Nordfeldth
1517deeeb6
Since ActivityContext::CONVERSATION changed to 'conversation' instead of 'ostatus:conversation' we need to add it ourselves
...
the xmlstringerthinger doesn't really use namespaces afaik
2017-05-06 15:27:25 +02:00
Mikael Nordfeldth
0dd68d11cb
What just happened? Not sure if me or git caused duplicate code.
2017-05-06 14:48:04 +02:00
Mikael Nordfeldth
4f37c564a5
Merge branch 'master' into mmn_fixes
2017-05-06 14:40:06 +02:00
Mikael Nordfeldth
5ad2f2873e
...and make sure we checkschema on Notice_prefs on upgrade...
2017-05-06 14:38:50 +02:00
Mikael Nordfeldth
966971bd12
Revert some of 8a4bec811b
...
use Notice_prefs instead of adding a new field. The rationale here
is simply that the Notice table was _huge_ and I rant into issues
with /tmp filling up when altering the tables. So let's just create
a new table instead.
2017-05-06 14:38:48 +02:00
Mikael Nordfeldth
7767c57087
Notice_prefs now available (I just copied Profile_prefs)
2017-05-06 14:38:47 +02:00
Mikael Nordfeldth
ba4a84602a
Output proper HTML and XML headers for single Atom entry
...
RFC5023 <https://tools.ietf.org/html/rfc5023 > specifies that the
content type parameter 'type=entry' should be used to clarify data.
2017-05-06 14:38:46 +02:00
Mikael Nordfeldth
d115f9dd1b
Output selfLink from notice asActivity[Object]
2017-05-06 14:38:45 +02:00
Mikael Nordfeldth
1ccb934541
Return false immediately if $url is empty for common_valid_http_url
2017-05-06 14:38:43 +02:00
Mikael Nordfeldth
434956fc75
Notices start saving selfLink from activities/objects
2017-05-06 14:38:42 +02:00
Mikael Nordfeldth
7da925ca70
Handle selfLink in ActivityObject
2017-05-06 14:38:41 +02:00
Mikael Nordfeldth
3a7d8efc57
...and make sure we checkschema on Notice_prefs on upgrade...
2017-05-06 13:54:42 +02:00
Mikael Nordfeldth
286b1e0ab7
Revert some of 8a4bec811b
...
use Notice_prefs instead of adding a new field. The rationale here
is simply that the Notice table was _huge_ and I rant into issues
with /tmp filling up when altering the tables. So let's just create
a new table instead.
2017-05-06 13:24:11 +02:00
Mikael Nordfeldth
2cbef2b10f
Notice_prefs now available (I just copied Profile_prefs)
2017-05-06 13:22:10 +02:00
Mikael Nordfeldth
d88e9ffd33
Output proper HTML and XML headers for single Atom entry
...
RFC5023 <https://tools.ietf.org/html/rfc5023 > specifies that the
content type parameter 'type=entry' should be used to clarify data.
2017-05-06 12:38:34 +02:00
Mikael Nordfeldth
7c829852b8
Output selfLink from notice asActivity[Object]
2017-05-06 12:26:54 +02:00
Mikael Nordfeldth
709f1bbd75
Return false immediately if $url is empty for common_valid_http_url
2017-05-06 12:25:27 +02:00
Mikael Nordfeldth
8a4bec811b
Notices start saving selfLink from activities/objects
2017-05-06 12:15:54 +02:00
Mikael Nordfeldth
7889b21e7b
Handle selfLink in ActivityObject
2017-05-06 11:57:16 +02:00
Mikael Nordfeldth
000af6d9ee
default to #addtag on !group mention
2017-05-02 21:21:53 +02:00
Mikael Nordfeldth
07458e5375
Fixed the parsing of ostatus:conversation etc.
...
Conversation will now start storing remote URL
The namespace features don't work the way they were written for here
so I fixed that, making the ostatus: namespace properly looked up and
then the homegrown getLink function looks for what is back-compat with
StatusNet etc. if I remember correctly.
2017-05-02 18:58:22 +02:00
Mikael Nordfeldth
e8eb9f9614
Less raw database dumps in debug please
2017-05-02 09:18:43 +02:00
Mikael Nordfeldth
e9ab06b59e
Fix issues with non-subscribed Ostatus_profiles
2017-05-02 09:14:30 +02:00
Mikael Nordfeldth
979c525124
I like to throw exceptions instead of using if statements.
2017-05-02 09:07:39 +02:00
Mikael Nordfeldth
06b25f384a
File_redirection->getFile could never get the file anyway if $redir->file_id was empty...
2017-05-02 09:07:00 +02:00
Mikael Nordfeldth
5af5bb2a32
Show WebSub state on remote user profiles
2017-05-01 21:18:04 +02:00
Mikael Nordfeldth
caa5fb75b3
Introduce neat function getFeedSub() on Ostatus_profile
2017-05-01 21:17:22 +02:00
Mikael Nordfeldth
f4d6710a0f
Change mentions of PuSH to WebSub
...
WebSub is probably finalised before we make a release anyway. Here is
the official spec: https://www.w3.org/TR/websub/
Mostly just comments that have been changed. Some references to PuSH <0.4
are left because they actually refer to PuSH 0.3 and that's not WebSub...
The only actual code change that might affect anything is FeedSub->isPuSH()
but the only official plugin using that call was FeedPoller anyway...
2017-05-01 11:04:27 +02:00
Mikael Nordfeldth
b3da5bdaa3
Debugging log fix.
2017-05-01 10:36:55 +02:00
Mikael Nordfeldth
f6d4d00e02
I think this will stop my daemons from endlessly looping
...
I got this which ate all my memory:
queuedaemon.php:10733] HTTPClient: HTTP HEAD https://drive.google.com/file/d/*masked*/view?usp=sharing - 200 OK
queuedaemon.php:10733] Checking for remote URL metadata for https://drive.google.com/file/d/*masked*/view?usp=sharing
queuedaemon.php:10733] HTTPClient: HTTP GET https://drive.google.com/file/d/*masked*/view?usp=sharing - 200 OK
queuedaemon.php:10733] Trying to discover an oEmbed endpoint using link headers.
queuedaemon.php:10733] Could not find an oEmbed endpoint using link headers, trying OpenGraph from HTML.
queuedaemon.php:10733] HTTPClient: HTTP HEAD https://drive.google.com/file/d/*masked*/view?usp=sharing&usp=embed_facebook - 200 OK
queuedaemon.php:10733] Checking for remote URL metadata for https://drive.google.com/file/d/*masked*/view?usp=sharing&usp=embed_facebook
queuedaemon.php:10733] HTTPClient: HTTP GET https://drive.google.com/file/d/*masked*/view?usp=sharing&usp=embed_facebook - 200 OK
queuedaemon.php:10733] Trying to discover an oEmbed endpoint using link headers.
queuedaemon.php:10733] Could not find an oEmbed endpoint using link headers, trying OpenGraph from HTML.
queuedaemon.php:10733] HTTPClient: HTTP HEAD https://drive.google.com/file/d/*masked*/view?usp=sharing&usp=embed_facebook&usp=embed_facebook - 200 OK
queuedaemon.php:10733] Checking for remote URL metadata for https://drive.google.com/file/d/*masked*/view?usp=sharing&usp=embed_facebook&usp=embed_facebook
queuedaemon.php:10733] HTTPClient: HTTP GET https://drive.google.com/file/d/*masked*/view?usp=sharing&usp=embed_facebook&usp=embed_facebook - 200 OK
queuedaemon.php:10733] Trying to discover an oEmbed endpoint using link headers.
queuedaemon.php:10733] Could not find an oEmbed endpoint using link headers, trying OpenGraph from HTML.
...ad nauseam.
2017-05-01 10:27:21 +02:00
Mikael Nordfeldth
37c97ac8fc
Message to end-user on why FeedSub failed.
2017-05-01 07:40:16 +02:00
Mikael Nordfeldth
5ac20a4d30
Clearing cache showed my layout fail!
2017-05-01 07:39:56 +02:00