documentation/architecture design proposal.md

273 lines
15 KiB
Markdown
Raw Normal View History

2023-10-03 15:41:47 +02:00
---
gitea: none
title: WordPress/ActivityPub
lang: en
authors:
- André Menrath
- ruru
include_toc: true
---
2023-10-03 15:45:21 +02:00
This document describes proposals for the evolvment of the [WordPress ActivityPub plugin](https://github.com/Automattic/WordPress-ActivityPub/) in the field of the interaction with other WordPress plugins that may add additional ActivityPub features.
2023-10-03 15:41:47 +02:00
2023-10-03 15:45:21 +02:00
# Terms used
2023-10-03 15:41:47 +02:00
The following terms are used:
2023-10-03 15:45:21 +02:00
## Actor related
2023-10-03 15:41:47 +02:00
2023-10-05 10:46:22 +02:00
- **Actors:** ActivityPub [Actor Objects](https://www.w3.org/TR/activitypub/#actor-objects)
2023-10-03 16:45:00 +02:00
- **Actor Types:** ActivityPub [Actor Types](https://www.w3.org/TR/activitystreams-vocabulary/#actor-types)
2023-10-03 15:41:47 +02:00
- **WordPress actor types:** Things on WordPress that can be mapped to actors:
- WordPress users
- Whole site/blog (relay)
2023-10-05 10:48:09 +02:00
- (custom) post types
2023-10-03 15:41:47 +02:00
- **Mapping:** Which WordPress actor types are actually are mapped to any ActivityPub actors at all and to which one.
2023-10-03 15:45:21 +02:00
## Content related
2023-10-03 15:41:47 +02:00
2023-10-05 10:48:09 +02:00
- **post type:** Post type and custom post types within WordPress
2023-10-03 15:41:47 +02:00
- **Object Type:** ActivityPub [Object-Type](https://www.w3.org/TR/activitystreams-vocabulary/#object-types)
2023-10-05 11:56:20 +02:00
- **Transformers:** a piece of code that converts items of a particular WordPress post type to an ActivityPub object of (a) specified type(s). For example a transformer that can transform:
2023-10-03 15:41:47 +02:00
- `post` to a `Note`
- `post` to a `Article`
- `post` to `Note`, `Article`, `Image`, `Audio` or `Article` depending on the [post-format](https://wordpress.org/documentation/article/post-formats/)
- `tribe_events` (Event post the of [The Event Calendar](https://wordpress.org/plugins/the-events-calendar/)) to `Event`
2023-10-05 11:56:20 +02:00
- `podcast` (Podcast post of [Podlove Podcast Publisher](https://github.com/podlove/podlove-publisher)) to `PodcastEpisode` as ([proposed and implemented by Castopod](https://code.castopod.org/adaures/castopod/-/blob/main/app/Libraries/PodcastEpisode.php))
2023-10-03 15:41:47 +02:00
2023-10-03 15:45:21 +02:00
## General
2023-10-03 15:41:47 +02:00
2023-10-05 11:56:20 +02:00
- **publish/dispatch:** Sending a `Create`, `Update` or `Announce` [Activity](https://www.w3.org/TR/activitypub/#create-activity-outbox).
2023-10-03 15:41:47 +02:00
2023-10-03 15:45:21 +02:00
# Principals of the changes proposed to the ActivityPub plugin
2023-10-03 15:41:47 +02:00
The WordPress ActivityPub plugin
- should be aware (or even control) the whole chain from creating some content within WordPress to being published via ActivityPub. For sure, it should be the only plugin that directly sends and receives ActivityPub.
- should not get any more complex by default, the out-of-the box functionality/features and simplicity should be similar to version 1.0.0.
- offers other plugins the possibility to register custom transformers.
- (maybe) offers other plugins the possibility to register new WordPress actor types, e.g. the `tribe_organizer` post type of [The Event Calendar](https://wordpress.org/plugins/the-events-calendar/).
- handles the controls collisions of actor names:
* collisions that are already present during activation of a WordPress actor type on the settings page
* collisions that happen afterwards (e.g. a new user registering with the same username as the blog-wide actor)
2023-10-05 11:56:20 +02:00
* (maybe) show notifications/warnings when using an actor name which has been used and followed by in the past, as there may be issues due to caching of the old public key.
2023-10-03 15:41:47 +02:00
- maybe distinguishes between the default admin user interface and advanced sections which give the user more fine-grained control:
* transformer management
* actor management
2023-10-03 15:45:21 +02:00
# Goals
2023-10-03 15:41:47 +02:00
Our primary goal is to make it possible that events created within an event plugin can federate properly as an ActivityPub object with Type `Event` along with all the meta-data belonging to the event, as found in common ActivityPub implementations, e.g. of Mobilizon, in order to ensure maximum compatibly between those services.
Nevertheless, we see a lot of other cases that can benefit, if we achieve this using a modularized approach as proposed below. The following list indicates examples what might be those other benefits:
- Other types of content get federated in a more feature rich way:
2023-10-05 11:56:20 +02:00
- `PodcastEpisode` [as proposed by CastoPod](https://code.castopod.org/adaures/castopod/-/blob/main/app/Libraries/PodcastEpisode.php)
- `Question`
2023-10-03 15:41:47 +02:00
- `Product`
- ...
- ActivityPub offers features how to deal with multilingual content ([contentMap - see Example 115](https://www.w3.org/TR/activitystreams-vocabulary/#dfn-contentmap)) which could be implemented differently by multilingual and translation plugins (example search for the current use of `->set_content_map` within the ActivityPub plugin).
2023-10-03 15:45:21 +02:00
# Transformer Management
2023-10-03 15:41:47 +02:00
2023-10-03 15:45:21 +02:00
## User Interface
2023-10-03 15:41:47 +02:00
2023-10-03 15:45:21 +02:00
### Current situation
2023-10-03 15:41:47 +02:00
The admin user interface in v1.0.0 lets one choose to which object type all post get transformed to. The options are:
* [x] Note (default) - Should work with most platforms.
* [ ] Article - The presentation of the "Article" might change on different platforms.
* [ ] WordPress Post-Format - Maps the WordPress Post-Format to the ActivityPub Object Type.
2023-10-03 15:45:21 +02:00
### Proposal
2023-10-03 15:41:47 +02:00
Every public WordPress post type may be transformed (have different transformers available) to a different ActivityPub object types. Transformations that are not
2023-10-05 10:48:09 +02:00
available for a given post type are greyed out.
2023-10-03 15:41:47 +02:00
| | Note | Article | Page | Event |
| ----------------- |:----:|:-------:|:----:|:-----:|
| **post** | X | O | O | - |
| **page** | O | X | O | - |
| **tribe_events** | O | - | - | X |
| **...** | O | - | - | - |
2023-10-05 10:48:09 +02:00
x: ActivityPub object-types, y: WordPress post types
2023-10-03 15:41:47 +02:00
2023-10-05 10:48:09 +02:00
- For any custom post type, if there is a custom transformer registered, indicate that one should be selected as default (or select it right ahead?).
2023-10-03 15:41:47 +02:00
- Should not differ too much from the current view: Maybe completely hide the current Activity-Object-Type part of the settings and only show the buttons for `enable` and `disable` and move the transformer table to an advanced settings page.
2023-10-03 15:45:21 +02:00
### Problems
2023-10-03 15:41:47 +02:00
- If two transformers with the same source and target are installed, then we have two possibilities:
1. A dropdown menu is displayed to select one of the transformers.
2. Adding another column and maybe add indicators where the transformer comes from (e.g. `builtin`, `custom` or showing the source)
- Should a transformer be always a many-to-one relationship or may it be a many-to-many one.
2023-10-05 11:56:20 +02:00
- Highly unlikely: Do we really want to manage which transformers apply to what directly or do users prefer a setting like "let a certain plugin take care of this post type"? Then further configuration would have to be managed by the other plugins.
2023-10-03 15:41:47 +02:00
2023-10-03 15:45:21 +02:00
## Backend
2023-10-03 15:41:47 +02:00
2023-10-05 10:48:09 +02:00
Currently, only one hard-coded transformer exists in [`includes/transformer/class post.php`](https://github.com/Automattic/wordpress-activitypub/blob/master/includes/transformer/class post.php).
2023-10-03 15:41:47 +02:00
```php
/**
* WordPress Post Transformer
*
* The Post Transformer is responsible for transforming a WP_Post object into different othe
* Object-Types.
*
* Currently supported are:
*
* - Activitypub\Activity\Base_Object
*/
class Post {
...
/**
* Transforms the WP_Post object to an ActivityPub Object
*
* @see \Activitypub\Activity\Base_Object
*
* @return \Activitypub\Activity\Base_Object The ActivityPub Object
*/
public function to_object() {
...
```
A solution could be to define a transformer interface and let the transformers be implementations.
```php
interface Transformer {
public function get_supported_post_types(): array;
public function get_target_activitypub_object_type(): string;
public function to_object(WP_Post $post);
....
}
```
Use WordPress's hook system or a public API function to let other plugins register their custom transformer implementations to the ActivityPub plugin.
2023-10-03 15:45:21 +02:00
### Problem
2023-10-03 15:41:47 +02:00
With the design above the transformer does a lot and leaves a lot of responsibility to the developer implementing it.
Possible alternatives and solutions:
- The ActivityPub plugin could provide reusable Traits for common tasks.
- The ActivityPub plugin provides an even more height level framework for adding transformers. For example for events the ActivityPub plugin could provide a built-in transformer to the object type `Event` which only needs a mapping (might make things harder, instead of making them easier). See Appendix.
- Don't use an interface with implementations, (miss)use class extensions.
2023-10-05 11:56:20 +02:00
# Mapping: Actors and Dispatching
2023-10-03 15:41:47 +02:00
More comprehensive actor management would benefit our project aims and potentially meet the needs of others in the future. Nevertheless, **its importance is considerably lower than that of Transformer management**. In the future, the following factors may become more important when larger websites should be using the ActivityPub plugin.
2023-10-05 11:56:20 +02:00
## Current situation
2023-10-03 15:41:47 +02:00
Currently, the admin user interface in v1.0.0 gives very limited options.
```
- [ ] Enable `blog`-actor
- [ ] Enable `author`-actors
```
Note that depending on which options are enabled, the method of federating via ActivityPub varies significantly:
- If the `blog`-actor is enabled, but the `author`-actors are not, posts are attributed and created by the blog actor.
- If both are enabled the `blog`-actor will announce (boosting) the posts of the
`author`-actors.
2023-10-05 11:56:20 +02:00
Currently the whole logic controlling this is written within the `Activity_Dispatcher` [class](https://github.com/Automattic/wordpress-activitypub/blob/master/includes/class-activity-dispatcher.php#L21).
2023-10-03 15:45:21 +02:00
## Possibilities
2023-10-03 15:41:47 +02:00
ActivityPub knows several [actor types](https://www.w3.org/TR/activitystreams-core/#actors):
- Application
- Group
- Organization
- Person
- Service
The specifications allow for a lot of flexibility in their use. As WordPress websites serve a variety of tasks and goals, providing more detailed capabilities and options in this area **may prove challenging to accomplish in a user-friendly manner**.
2023-10-03 15:45:21 +02:00
## What features does our event federation project need?
2023-10-03 15:41:47 +02:00
- For maximum Mobilizon compatibility we would love to have simply an actor of type `Application`, preferable called `@relay@wordpress.site`, that announces all events. Nonetheless, in theory, a Mobilizon instance should have the capability to follow any other actor as well.
- Additionally, for example, organizers in [The Event Calendar](https://wordpress.org/plugins/the-events-calendar/) could also offer their own actor of type `Organizer` or `Group` to publicize events, or create events if the `author`-actors are not enabled.
2023-10-05 11:56:20 +02:00
- Optional: As events are sometimes published a long time before they start, adding the posibility that events get announced again at a scheduled time before the start, e.g. by sending an `Announce` activity.
2023-10-03 15:45:21 +02:00
## Other features
2023-10-03 15:41:47 +02:00
Other WordPress actor types might have valid use cases, like actors for categories, or specific post types in general: "I only want to see the blog updates, but I do not want to spam my timeline with each product they post on their site, even if they choose to federate them."
2023-10-03 15:45:21 +02:00
### Problems
2023-10-03 15:41:47 +02:00
- Overall complexity may lead to programming and usage errors.
- Naming collisions become more likely.
- Who is the `actor`, who is the `attributedTo`, who is just sending an `Announce` of a post?
2023-10-03 15:45:21 +02:00
## Proposed starting point for evaluating use cases
2023-10-03 15:41:47 +02:00
We keep in mind that every post type shall only ever send as a `Create` Activity once by one single actor.
2023-10-03 15:45:21 +02:00
### User Interface
2023-10-03 15:41:47 +02:00
| | users | tribe_organizers | custom | blog | category |
| -----------------|:-----:|:----------------:|:------:|:-----:|:--------:|
| **post** | C | O | O | A | A |
| **page** | C | O | O | A | O |
| **tribe_events** | O | C | - | A | 0 |
| **product** | O | - | C | 0 | 0 |
**x:** WordPress actor-types
2023-10-05 10:48:09 +02:00
**y:** WordPress post types
2023-10-03 15:41:47 +02:00
**C:** Create
**A:** Announce
**user:** the WordPress user publishing or updating something
**all:** blog-wide actor, everything that is published (like a relay)
**custom:** e.g. only a certain post_type that gets announced with this actor
**tribe_organizers:** only posts by one organizer
- Only allow setting something to `Announce`, when a `Create` is already set.
- Maybe forbid, that a user can automatically announce a post, because it's the "lowest level".
2023-10-03 15:45:21 +02:00
## Actor collisions
2023-10-03 15:41:47 +02:00
Each ActivityPub actor must have a [unique ID](https://www.w3.org/TR/activitypub/#obj-id). In our case this is a HTTPS URI.
But in reality [webfinger](https://webfinger.net/) is used: `@actor-name@instance.tld`. Actors like Persons and Groups and Applications have Public Keys attached to them, as well as their ID is probably cached by most software. So assigning some actor-name to something new also can cause unintended behavior.
If multiple plugins want to individually federate their content (like events, products and blog posts or even the built-in WordPress categories), they must be able to have something like an actor API, the ActivityPub plugin can register. The ActivityPub plugin being the main coordinator is necessary because actors are globally unique.
- For existing (collision was created before the installation/activation of the plugin)
- For new collisions (collision was/will be created after the installation/activation of the plugin)
It seems like it is the best if collisions are avoided in the first place by encouraging the use of prefixes, like `category_<category>`.
Anyway it seems the question has to be raised wheter activitypub should store a history of all past and currently mapped actors.
2023-10-03 15:45:21 +02:00
### Existing collisions
2023-10-03 15:41:47 +02:00
- **Easy:** Either we just tell the user to resolve all conflicts before a WordPress actor type can be activated at all
- **Complex:** We let him choose alternatives for conflicts.
2023-10-03 15:45:21 +02:00
### New collisions
2023-10-03 15:41:47 +02:00
- **Easy** Forbid the saving of new users or posts that would conflict with an existing actor.
- **Complex** ...
2023-10-03 15:45:21 +02:00
## Conclusion
2023-10-03 15:41:47 +02:00
- Anyway it seems the question has to be raised whether the ActivityPub plugin should store a history of all past and currently mapped actors.
- Additionally, shouldn't the user have a detailed overview in each case if the actor management should get more complex?
2023-10-03 15:45:21 +02:00
### Proposal of how plugins register WordPress-actor types
2023-10-03 15:41:47 +02:00
```php
interface ActorType {
public function getActorTypeName(); // returns name of the ActorType
public function listActorsOfThisType(); // returns array of actors of this type
public function listPostsForThisActor($actor); // returns array of posts
}
```
The registration of an actor type also registers every actor that is currently in the `listActorsOfThisType()`-list.
2023-10-03 15:45:21 +02:00
# Appendix
2023-10-03 15:41:47 +02:00
2023-10-03 15:45:21 +02:00
## The approach of youtube-dl
2023-10-03 15:41:47 +02:00
[youtube-dl](https://github.com/ytdl-org/youtube-dl) is solving a similar problem with "extractors" that return data to the processing-chain of youtube-dl. They provide a base class that includes useful functions for common issues e.g. automatic testing, geo-bypassing, login/cookie/header management. The most [basic extractor](https://github.com/ytdl-org/youtube-dl#adding-support-for-a-new-site) is about 40 lines of code.
2023-10-03 16:45:00 +02:00
They can also chain extractors recursivly, like a extractor for mastodon videos, that gets the video from the post and returns the source of the video, that could be youtube, vimeo or anything else youtube-dl supports.