Commit Graph

797 Commits

Author SHA1 Message Date
Evan Prodromou
e34ece8b06 Merge branch '0.9.x' of git@gitorious.org:statusnet/mainline into 0.9.x 2010-01-12 23:25:25 -08:00
Brion Vibber
ec145b73fc Major refactoring of queue handlers to support running multiple sites in one daemon.
Key changes:
* Initialization code moved from common.php to StatusNet class;
  can now switch configurations during runtime.
* As a consequence, configuration files must now be idempotent...
  Be careful with constant, function or class definitions.
* Control structure for daemons/QueueManager/QueueHandler has been refactored;
  the run loop is now managed by IoMaster run via scripts/queuedaemon.php
  IoManager subclasses are woken to handle socket input or polling, and may
  cover multiple sites.
* Plugins can implement notice queue handlers more easily by registering a
  QueueHandler class; no more need to add a daemon.

The new QueueDaemon runs from scripts/queuedaemon.php:

* This replaces most of the old *handler.php scripts; they've been refactored
  to the bare handler classes.
* Spawns multiple child processes to spread load; defaults to CPU count on
  Linux and Mac OS X systems, or override with --threads=N
* When multithreaded, child processes are automatically respawned on failure.
* Threads gracefully shut down and restart when passing a soft memory limit
  (defaults to 90% of memory_limit), limiting damage from memory leaks.
* Support for UDP-based monitoring: http://www.gitorious.org/snqmon

Rough control flow diagram:
QueueDaemon -> IoMaster -> IoManager
                           QueueManager [listen or poll] -> QueueHandler
                           XmppManager [ping & keepalive]
                           XmppConfirmManager [poll updates]

Todo:

* Respawning features not currently available running single-threaded.
* When running single-site, configuration changes aren't picked up.
* New sites or config changes affecting queue subscriptions are not yet
  handled without a daemon restart.
* SNMP monitoring output to integrate with general tools (nagios, ganglia)
* Convert XMPP confirmation message sends to use stomp queue instead of polling
* Convert xmppdaemon.php to IoManager?
* Convert Twitter status, friends import polling daemons to IoManager
* Clean up some error reporting and failure modes
* May need to adjust queue priorities for best perf in backlog/flood cases

Detailed code history available in my daemon-work branch:
http://www.gitorious.org/~brion/statusnet/brion-fixes/commits/daemon-work
2010-01-12 20:45:09 -08:00
Brion Vibber
9c34d5c107 Actually skip the pingback if XML-RPC extension is missing, instead of considering it then trying anyway and dying of a fatal error. :) 2010-01-12 12:12:31 -08:00
Evan Prodromou
ecb3abf84c Merge branch '0.9.x' into inblob 2010-01-11 16:28:27 -08:00
Evan Prodromou
7e5c15fa80 Merge branch '0.9.x' of git@gitorious.org:statusnet/mainline into 0.9.x 2010-01-11 16:23:48 -08:00
Evan Prodromou
04c76fc4e5 safer storage for diskcacheplugin 2010-01-11 16:23:34 -08:00
Brion Vibber
116c5f6839 dos -> unix line endings on CasAuthentication's CAS library 2010-01-11 15:42:17 -08:00
Evan Prodromou
bd6571c2e1 Merge branch 'diskcache' into 0.9.x 2010-01-11 15:34:27 -08:00
Sarven Capadisli
aaea2b1a96 Apparently, I can't spell my family name. 2010-01-11 13:02:04 +01:00
Evan Prodromou
8809e577b2 Merge branch 'sessionidparam' into 0.9.x
Conflicts:
	lib/command.php
2010-01-11 00:45:26 -08:00
Evan Prodromou
92deb35bc4 inject session before redirect for openid finish login 2010-01-11 08:40:41 +00:00
Craig Andrews
a07d8dab25 i18n in the imap plugin 2010-01-09 19:04:53 -05:00
Craig Andrews
c758b1b1d4 Add version information to a bunch of plugins 2010-01-09 19:04:53 -05:00
Evan Prodromou
2db840b2f5 use Inbox in twitterstatusfetcher 2010-01-09 14:02:01 -08:00
Evan Prodromou
d902de139c change PuSH plugin to use whoGets() 2010-01-09 13:59:39 -08:00
Evan Prodromou
9cfea6d051 use whoGets() for realtime plugin 2010-01-09 13:56:54 -08:00
Craig Andrews
055f3fdddb Add an IMAP daemon so StatusNet can process incoming user posts via catch-all mailbox (in addition to the pre-existing script alias method) 2010-01-08 18:52:43 -05:00
Evan Prodromou
e22af049a8 persistent connection flag, default false on cli 2010-01-08 13:21:29 -08:00
Sarven Capadisli
647bbb916c Updated RealtimePlugin to use core json2.js 2010-01-08 13:36:31 +00:00
Sarven Capadisli
ce761c7142 Updated plugin info for PoweredByStatusNet 2010-01-08 11:42:03 +00:00
Evan Prodromou
4f62d685d0 Mapstraction PluginVersion 2010-01-08 00:38:20 -08:00
Evan Prodromou
c57fe7fbf5 PluginVersion for WikiHashtags 2010-01-08 00:29:09 -08:00
Evan Prodromou
87043797bf Merge branch '0.9.x' of git@gitorious.org:statusnet/mainline into 0.9.x 2010-01-08 00:21:58 -08:00
Evan Prodromou
054aaa40bf add versions for url-shortener plugins 2010-01-08 00:20:38 -08:00
Zach Copley
20af83d316 Add version info for Facebook, TwitterBridge and RSSCloud plugins 2010-01-08 00:09:23 -08:00
Evan Prodromou
11b19788f5 add version information to GeoURL 2010-01-07 17:58:48 -08:00
Evan Prodromou
fe01a7d183 add version information to Linkback 2010-01-07 17:58:38 -08:00
Evan Prodromou
87c181b4e3 add version information to GoogleAnalytics 2010-01-07 17:51:57 -08:00
Evan Prodromou
ca3b2d614a add version information to MemcachePlugin 2010-01-07 17:49:39 -08:00
Evan Prodromou
6395ac71b8 add version information to PiwikAnalyticsPlugin 2010-01-07 17:47:23 -08:00
Evan Prodromou
afaefa6942 add version info to the Template plugin 2010-01-07 17:43:56 -08:00
Evan Prodromou
0587dcc045 add version info to OpenID plugin 2010-01-07 17:41:55 -08:00
Evan Prodromou
1c824a52ec Add version info to the CacheLog plugin 2010-01-07 17:39:15 -08:00
Evan Prodromou
42834944e0 add version info to SamplePlugin 2010-01-07 17:37:44 -08:00
Evan Prodromou
ff930d2555 add version information to Geonames plugin 2010-01-07 17:27:01 -08:00
Evan Prodromou
a55939f3b1 Merge branch '0.9.x' of git@gitorious.org:statusnet/mainline into 0.9.x 2010-01-06 23:23:30 -08:00
Evan Prodromou
e1c7851a06 pass through keys() as keyTypes() for UserFlag 2010-01-06 23:22:49 -08:00
Brion Vibber
4e2acd153b ...and drop the unnecessary &reference from child class pkeyGet() overrides. 2010-01-06 14:28:40 -08:00
Craig Andrews
20144285ca The structure return by parse_url is an associative array, not an object. 2010-01-06 17:13:09 -05:00
Craig Andrews
208bab32b7 Remove erroneous call to parent::onInitializePlugin() 2010-01-06 16:48:52 -05:00
Brion Vibber
b93244395f Fix for broken profile flag admin UI: delete stray flag entries when users are deleted so broken entries don't litter the lookups.
* added ProfileDeleteRelated event to match UserDeleteRelated, to allow plugins to add extra related tables on profile deletion
* UserFlagPlugin: deleting flags when target profile is deleted
* UserFlagPlugin: deleting flags when flagging user is deleted
* UserFlagPlugin: fix for autoloader -- class names are case-insensitive. We may get lowercase class names coming in at times, such as when creating DB objects programatically from a table name.

Note that any already-existing bogus entries need to be removed from the database:
select * from user_flag_profile where (select id from profile where id=profile_id) is null;
select * from user_flag_profile where (select id from user where id=user_id) is null;
2010-01-06 11:10:33 -08:00
Sarven Capadisli
d7e2a29498 Removed unnecessary internal style 2010-01-06 11:31:06 +01:00
Zach Copley
c95114ea02 Some better log msgs 2010-01-06 07:44:34 +00:00
Zach Copley
fd33865258 Fix subscription path in link element 2010-01-05 23:21:57 -08:00
Zach Copley
3e6b80d3e9 Some phpcs cleanup 2010-01-05 23:21:57 -08:00
Zach Copley
655dbcedb3 Comment out the LoggingAggregator business 2010-01-05 23:21:57 -08:00
Zach Copley
aad54af448 Reject subscription requests for handlers that don't support http-post 2010-01-05 23:21:46 -08:00
Zach Copley
48af79dbb4 Added a bunch of function commment blocks 2010-01-05 23:19:13 -08:00
Zach Copley
c571c1323f Added intial README 2010-01-05 23:19:13 -08:00
Zach Copley
ff26b8d88b Add an RSSCloud queue handler daemon 2010-01-05 23:19:13 -08:00
Zach Copley
d091d06115 Notifier works, and bad subscriptions are deleted properly now. 2010-01-05 23:19:13 -08:00
Zach Copley
61804bb7bb Plugin now checks notify handlers before registering subscriptions 2010-01-05 23:19:13 -08:00
Zach Copley
4e07d9eeec Better .ini info for RSSCloud subscription 2010-01-05 23:18:58 -08:00
Zach Copley
6b28fbe7b6 Make dummy aggregator handle RSSCloud challenge/response with domain parameter 2010-01-05 23:17:35 -08:00
Zach Copley
7638e2713d Set modified column correctly. 2010-01-05 23:17:35 -08:00
Zach Copley
3209544b30 Fixed DB_DataObject to return the right keys info for a compound
key & fix ini output
2010-01-05 23:16:58 -08:00
Zach Copley
8980bebcb3 Add a table and DB_DataObject class for storing cloud subscriptions 2010-01-05 22:59:42 -08:00
Zach Copley
aa9f81193e Queue notices for rssCloud 2010-01-05 22:59:42 -08:00
Zach Copley
46ac99cf4d Only add rssCloud link to user timeline 2010-01-05 22:59:42 -08:00
Zach Copley
51ac7439e1 /rsscloud/request_notify should work now 2010-01-05 22:59:42 -08:00
Zach Copley
391003c3c6 Some foundational work. Not much to see here. Move along. 2010-01-05 22:59:42 -08:00
Zach Copley
4e033138b3 Test action to simulate an aggregator. Useful for checking that the cloud hub is sending notifications. 2010-01-05 22:59:42 -08:00
Zach Copley
07f71a66f5 Extremely nascent RSSCloud plugin 2010-01-05 22:59:42 -08:00
Craig Andrews
0f6ccee6d3 remove invalid calls to AuthenticationPlugin::onAutoload 2010-01-06 00:22:19 -05:00
Craig Andrews
3b5299b5ca Use plugin configuration instead of common_config() 2010-01-06 00:20:15 -05:00
Craig Andrews
76cc791642 Use common_{log,debug} instead of error_log for logging 2010-01-06 00:09:07 -05:00
Craig Andrews
fffd66bf83 Add shiny's mollom plugin 2010-01-06 00:06:43 -05:00
Craig Andrews
9e2e0605ed Move Authorization and Authentication plugin structures into core, instead of as plugins.
This move makes sense as you can addPlugin('Authentication') for example - these are abstract classes designed to be implemented, not used directly.
2010-01-05 13:56:22 -05:00
Craig Andrews
f3a76bbcb7 Fix auth plugin autoregistration issue. 2010-01-05 13:42:15 -05:00
Evan Prodromou
f13cad656e remove logging stuff from DiskCache 2010-01-04 22:48:48 -10:00
Evan Prodromou
cde1f99838 Disk cache plugin 2010-01-04 15:16:28 -10:00
Evan Prodromou
6add2693b0 Merge branch '0.9.x' of git@gitorious.org:statusnet/mainline into 0.9.x 2010-01-04 10:55:21 -10:00
Evan Prodromou
96480aa6c1 XCachePlugin returns false value for cache miss 2010-01-04 10:12:19 -10:00
Evan Prodromou
928b5f8f2b Differentiate between empty values and cache misses in CacheLogPlugin 2010-01-04 09:57:48 -10:00
Craig Andrews
c0e4d7bfa2 Add 'takeOverLogin' parameter for a real SSO feel 2010-01-04 14:43:31 -05:00
Evan Prodromou
bcddcb38ce make compression threshold and min savings config attrs for MemcachePlugin 2010-01-04 09:09:59 -10:00
Craig Andrews
e440b69e1a Allow an authentication plugin with the same provider_name other than the one that actually checked the password to autoregister a user
Allows for SSO-type plugins that don't have any information about the user other than their username to do autoregistration
2010-01-04 13:35:11 -05:00
Brion Vibber
783a2e249b Fix for auto_increment parameter in auto-created tables via checkschema.
Update FeedSub plugin for non-Plugin_DataObject setup and working checkschema updates.
2010-01-04 10:30:58 -08:00
Craig Andrews
7a2d72fe28 Enable memcache automatic compression, starting at 20k and only if compression gain is greater than 20%.
Allows storage of larger objects (over 1mb in size uncompressed), such as huge LDAP schemas.
Should also improve cache efficiency (allows more stuff to be stored in same memory) and reduce network latency (less data transfer)

(redo commit 1e9c03e199 which was apparently lost during pluginization)
2010-01-04 12:49:25 -05:00
Evan Prodromou
1053abd2e8 Debug utility to log cache access 2010-01-03 11:28:00 -10:00
Evan Prodromou
07236058f4 don't try to set an expiry for XCache 2010-01-03 11:27:36 -10:00
Evan Prodromou
eebc5d0d59 add keyTypes() for User_greeting_count 2010-01-03 11:27:09 -10:00
Evan Prodromou
e940790241 update SamplePlugin.php also 2010-01-03 11:18:26 -10:00
Evan Prodromou
1348c6e819 Expand SamplePlugin to show other best practices
I modified the SamplePlugin to show how to do some real processing,
adding a data class and an action class and modifying the main
menu to link to the new action. I added documentation comments to
all the methods and made sure the modules were PHPCS-clean.
2010-01-03 11:02:36 -10:00
Evan Prodromou
249b2632f2 First version of cache plugin for XCache variable cache 2010-01-03 06:38:15 -10:00
Evan Prodromou
d7436c10d0 Add a caching plugin for APC variable cache 2010-01-02 21:34:15 -10:00
Evan Prodromou
cc5534d180 First version of Memcache plugin 2010-01-02 21:16:59 -10:00
Zach Copley
e6c8f6a8f8 Removed crazy redundant broadcasting of notices by the FB app 2009-12-31 22:53:46 +00:00
Zach Copley
962eed904c - Use a stripped down new notice form for FB app because FB canvas apps
can't support image upload via multipart/form-data (and location sharing
  is iffy).
- Deal with new error code 100 from Facebook, which seem to be for
  inactive accounts.
2009-12-31 22:39:01 +00:00
Zach Copley
5621f85835 Change inline CSS stylesheet to be on a single line so it doens't blow out syntax highlighting in my editor 2009-12-31 22:39:01 +00:00
Zach Copley
450cd6774a Update to external Facebook libs 2009-12-31 22:39:01 +00:00
Evan Prodromou
053b8c600d Merge branch '0.9.x' of git@gitorious.org:statusnet/mainline into 0.9.x 2009-12-31 09:14:55 -10:00
Craig Andrews
176e0fdab7 Add missing required line so this plugin works if it's the first (or only) Authentication Plugin in use 2009-12-30 19:18:06 -05:00
Evan Prodromou
05e2b4d92d Merge branch 'master' into 0.9.x 2009-12-29 12:09:17 -08:00
Evan Prodromou
1e3fea17af don't add flag if it's already there at block time 2009-12-28 16:35:29 -08:00
Evan Prodromou
98a579fedf Merge branch 'master' into 0.9.x 2009-12-28 15:49:14 -08:00
Evan Prodromou
dd0aaac70e First version of blacklist plugin
First version of blacklist plugin. Replaces custom code in identi.ca's
config.php, which was getting scary and long. Also correctly handles
changed nicknames or URLs in profile settings and using 'forbidden'
URLs in notice text.
2009-12-28 12:42:22 -08:00
Evan Prodromou
d9efeb6ac3 optionally flag a profile for review when blocked 2009-12-28 11:02:44 -08:00
Evan Prodromou
6d3e6b4284 move flag creation to a method of data object 2009-12-28 10:58:49 -08:00
Evan Prodromou
a80fa17872 phpcs-clean User_flag_profile as best as possible 2009-12-28 09:15:07 -08:00
Evan Prodromou
4a5bac43c3 phpcs-clean flagprofile.php 2009-12-28 09:08:28 -08:00
Evan Prodromou
df98ddff0c phpcs-clean clearflag.php 2009-12-28 09:06:38 -08:00
Evan Prodromou
c8fd5403e5 PHPCS-clean adminprofileflags.php 2009-12-28 08:45:21 -08:00
Evan Prodromou
ea23111a56 PHPCS-clean UserFlagPlugin 2009-12-28 08:37:30 -08:00
Evan Prodromou
85b8b35f53 clear flags and show flaggers in adminflagprofile 2009-12-28 08:19:56 -08:00
Evan Prodromou
2c2a82fda0 add stuff for clearing flags to UserFlagPlugin 2009-12-28 08:19:22 -08:00
Evan Prodromou
75fbec2fa3 Add tools to clear flags
Added a form to clear all flags for a profile, when showed on
adminprofileflags list. Add an action to handle the form, and a right
for the action.
2009-12-28 07:58:33 -08:00
Evan Prodromou
4b7835caa5 pagination works for flagged profiles 2009-12-27 11:47:54 -08:00
Evan Prodromou
5d6b6bfd34 admin page checks for right to review flags 2009-12-27 11:04:53 -08:00
Evan Prodromou
0bb65f8739 Merge branch 'geonamesxml' into 0.9.x 2009-12-23 15:53:58 -08:00
Evan Prodromou
3e9cc76da5 Merge branch 'master' into 0.9.x 2009-12-23 15:53:55 -08:00
Evan Prodromou
c0f444f564 make sure Geonames API queries use correct arg separator 2009-12-23 12:16:22 -08:00
Evan Prodromou
cdc5052683 Convert Geonames plugin to use XML API instead of JSON
The XML API for Geonames contains much more detailed error information
than the JSON one. So, I've converted this plugin to use it instead.
It seems to be the preferred format for Geonames, so biting the bullet
on this makes sense.
2009-12-23 12:09:11 -08:00
Evan Prodromou
3262930ed4 Merge branch '0.9.x' of git@gitorious.org:statusnet/mainline into 0.9.x 2009-12-23 10:31:27 -08:00
Evan Prodromou
15b9f61842 Better error notification for Geonames plugin 2009-12-23 09:26:59 -08:00
Evan Prodromou
6b5a334c0e Better error notification for Geonames plugin 2009-12-23 09:26:43 -08:00
Evan Prodromou
f6bf952980 Merge branch 'testing' 2009-12-22 16:44:19 -08:00
Craig Andrews
6549e4779a First version of a CAS authentication plugin 2009-12-22 17:53:24 -05:00
Sarven Capadisli
83779afe41 Adjusted notice option alignment in MobileProfile 2009-12-22 00:06:59 +00:00
Sarven Capadisli
4c91f6bbfd Moving & replacing to the end of html and source data 2009-12-21 23:19:34 +00:00
Sarven Capadisli
5472779240 Added admin navigation item to MobileProfile 2009-12-21 15:09:12 +00:00
Craig Andrews
a43c310fbc Cache the LDAP schema in memcache (if memcache is available) 2009-12-19 15:10:57 -05:00
Eric Helgeson
4002c18065 Allow caching of ldap schema, greatly improves performance. 2009-12-18 18:27:45 -06:00
Eric Helgeson
490238faf6 search->count() doesnt seem to be cached, so we will 2009-12-18 18:27:15 -06:00
Eric Helgeson
f70c3b6ae9 Limit search to only the basedn we're looking in 2009-12-18 18:26:41 -06:00
Brion Vibber
2fb76eec62 Followup fix for ticket 1672: Twitter bridge !group->#hash conversion will now happen regardless of whether account was configured with oauth or basic auth (previously applied only on the oauth path) 2009-12-18 09:38:25 -05:00
Brion Vibber
8632974131 Followup fix for ticket 1672: Twitter bridge !group->#hash conversion will now happen regardless of whether account was configured with oauth or basic auth (previously applied only on the oauth path) 2009-12-18 09:36:30 -05:00
Sarven Capadisli
bf123d1461 Plugin that outputs 'powered by StatusNet' after site name 2009-12-17 15:28:50 -05:00
Evan Prodromou
f3d27cc3ae can't repeat your own notice posted through realtime 2009-12-15 16:19:11 -05:00
Evan Prodromou
608d1b206a Don't show repeater avatar in notice lists 2009-12-15 16:08:44 -05:00
Evan Prodromou
d6873beb9b make realtime plugin grok repeats 2009-12-15 15:47:37 -05:00
Sarven Capadisli
80b5a7fe60 Added .form_repeat notice option to received notices in Realtime plugin 2009-12-15 19:44:20 +00:00
Zach Copley
656d29080a Fix Twitter bridge so it responds reasonably to authorization errors. 2009-12-14 07:33:29 +00:00
Siebrand Mazeland
745e35ac1f (Puctuation) consistency in clientError() calls. 2009-12-13 18:55:17 +01:00
Brion Vibber
2f77d47fd4 Build stub .po template for Gravatar plugin 2009-12-11 16:28:51 -08:00
Evan Prodromou
79f81ad76d change Notice::saveNew() to use named arguments for little-used options 2009-12-11 11:29:51 -05:00
Eric Helgeson
08901c98c4 Changing avatar should broadcast the profile via OMB. 2009-12-10 21:07:47 -05:00
Evan Prodromou
c10fa99b04 remove the Repeat plugin (for now) 2009-12-10 15:16:44 -05:00
Evan Prodromou
f3628afa00 Merge branch '0.9.x' of git@gitorious.org:statusnet/mainline into 0.9.x 2009-12-10 14:45:47 -05:00
Craig Andrews
14f7c784a6 Add table() and keys() overrides to User_username 2009-12-10 14:40:26 -05:00
Evan Prodromou
37b0852fdb move forward form to plugin 2009-12-10 14:33:15 -05:00
Evan Prodromou
198e413a58 move inbox notice list to repeat plugin 2009-12-10 13:34:11 -05:00
Evan Prodromou
144faade3b move forwarding stuff to Repeat plugin 2009-12-10 13:31:16 -05:00
Eric Helgeson
155659dd1f Initial GravatarPlugin 2009-12-09 22:32:57 -05:00
Sarven Capadisli
83830c26e7 Added todo item to Realtime plugin 2009-12-09 11:37:53 +01:00
Sarven Capadisli
559415826a Added a todo list for Realtime plugin 2009-12-09 11:00:30 +01:00
Brion Vibber
4b5e977a7b New _m() gettext wrapper with smart detection of plugin domains. Plugin base class registers your gettext files if present at initialization.
update_pot.sh replaced with update_po_templates.php which can do core, plugins, or all (default).
Top-level Makefile added to build .mo files for plugins as well as core.

As described on list:
http://lists.status.net/pipermail/statusnet-dev/2009-December/002869.html
2009-12-08 12:17:11 -08:00
Eric Helgeson
684e65e3de Cleanup of recaptcha plugin remove xhtml hack 2009-12-07 14:53:17 -05:00
Brion Vibber
75b11527c7 Add a "grandfather" creation date cutoff to RequireValidatedEmail plugin; will allow us to use this for temporary emergency moderation of new registrations without affecting older accounts. 2009-12-07 11:31:04 -08:00
Brion Vibber
cba114c850 Add a "grandfather" creation date cutoff to RequireValidatedEmail plugin; will allow us to use this for temporary emergency moderation of new registrations without affecting older accounts. 2009-12-07 11:29:18 -08:00