2020-03-13 15:38:04 +01:00
|
|
|
# Review Guidelines
|
|
|
|
|
|
|
|
The following summarises review guidelines that we follow for pull requests in
|
2020-07-17 13:53:28 +02:00
|
|
|
Element Web and other supporting repos. These are just guidelines (not strict
|
2020-03-13 15:38:04 +01:00
|
|
|
rules) and may be updated over time.
|
|
|
|
|
|
|
|
## Code Review
|
|
|
|
|
|
|
|
When reviewing code, here are some things we look for and also things we avoid:
|
|
|
|
|
|
|
|
### We review for
|
|
|
|
|
|
|
|
* Correctness
|
|
|
|
* Performance
|
|
|
|
* Accessibility
|
|
|
|
* Security
|
2020-08-26 16:57:31 +02:00
|
|
|
* Quality via automated and manual testing
|
2020-03-13 15:38:04 +01:00
|
|
|
* Comments and documentation where needed
|
|
|
|
* Sharing knowledge of different areas among the team
|
|
|
|
* Ensuring it's something we're comfortable maintaining for the long term
|
2020-03-26 12:28:47 +01:00
|
|
|
* Progress indicators and local echo where appropriate with network activity
|
2020-03-13 15:38:04 +01:00
|
|
|
|
|
|
|
### We should avoid
|
|
|
|
|
|
|
|
* Style nits that are already handled by the linter
|
|
|
|
* Dramatically increasing scope
|
|
|
|
|
|
|
|
### Good practices
|
|
|
|
|
|
|
|
* Use empathetic language
|
|
|
|
* See also [Mindful Communication in Code
|
|
|
|
Reviews](https://kickstarter.engineering/a-guide-to-mindful-communication-in-code-reviews-48aab5282e5e)
|
|
|
|
and [How to Do Code Reviews Like a Human](https://mtlynch.io/human-code-reviews-1/)
|
|
|
|
* Authors should prefer smaller commits for easier reviewing and bisection
|
|
|
|
* Reviewers should be explicit about required versus optional changes
|
|
|
|
* Reviews are conversations and the PR author should feel comfortable
|
|
|
|
discussing and pushing back on changes before making them
|
2020-08-26 16:57:31 +02:00
|
|
|
* Reviewers are encouraged to ask for tests where they believe it is reasonable
|
2020-03-13 15:38:04 +01:00
|
|
|
* Core team should lead by example through their tone and language
|
|
|
|
* Take the time to thank and point out good code changes
|
|
|
|
* Using softer language like "please" and "what do you think?" goes a long way
|
|
|
|
towards making others feel like colleagues working towards a common goal
|
|
|
|
|
|
|
|
### Workflow
|
|
|
|
|
2020-11-25 18:01:19 +01:00
|
|
|
* Authors should request review from the element-web team by default (if someone on
|
2020-03-30 12:52:23 +02:00
|
|
|
the team is clearly the expert in an area, a direct review request to them may
|
|
|
|
be more appropriate)
|
2020-03-18 11:59:33 +01:00
|
|
|
* Reviewers should remove the team review request and request review from
|
|
|
|
themselves when starting a review to avoid double review
|
2020-03-30 12:52:23 +02:00
|
|
|
* If there are multiple related PRs authors should reference each of the PRs in
|
|
|
|
the others before requesting review. Reviewers might start reviewing from
|
|
|
|
different places and could miss other required PRs.
|
|
|
|
* Avoid force pushing to a PR after the first round of review
|
2020-03-18 11:23:27 +01:00
|
|
|
* Use the GitHub default of merge commits when landing (avoid alternate options
|
|
|
|
like squash or rebase)
|
2020-03-13 15:38:04 +01:00
|
|
|
* PR author merges after review (assuming they have write access)
|
2020-03-18 11:59:46 +01:00
|
|
|
* Assign issues only when in progress to indicate to others what can be picked
|
|
|
|
up
|
2020-03-13 15:38:04 +01:00
|
|
|
|
2021-04-16 19:53:18 +02:00
|
|
|
## Code Quality
|
|
|
|
|
|
|
|
In the past, we have occasionally written different kinds of tests for
|
|
|
|
Element and the SDKs, but it hasn't been a consistent focus. Going forward, we'd
|
|
|
|
like to change that.
|
|
|
|
|
|
|
|
* For new features, code reviewers will expect some form of automated testing to
|
|
|
|
be included by default
|
|
|
|
* For bug fixes, regression tests are of course great to have, but we don't want
|
|
|
|
to block fixes on this, so we won't require them at this time
|
|
|
|
|
|
|
|
The above policy is not a strict rule, but instead it's meant to be a
|
|
|
|
conversation between the author and reviewer. As an author, try to think about
|
|
|
|
writing a test when making your next change. As a reviewer, try to think about
|
|
|
|
how you might test the area of code you are reviewing. If the reviewer agrees
|
|
|
|
it would be quite difficult to test some new feature, then it's okay for them to
|
|
|
|
accept the change without tests for now, but we'd eventually like to be more
|
|
|
|
strict about this further down the road.
|
|
|
|
|
|
|
|
If you do spot areas that are quite hard to test today, please let us know in
|
2021-04-19 18:02:11 +02:00
|
|
|
[#element-dev:matrix.org](https://matrix.to/#/#element-dev:matrix.org). We can
|
|
|
|
work on improving the app architecture and testing helpers so that future tests
|
|
|
|
are easier for everyone to write, but we won't know which parts are difficult
|
|
|
|
unless people shout when stumbling through them.
|
2021-04-16 19:53:18 +02:00
|
|
|
|
|
|
|
We recognise that this testing policy will slow things down a bit, but overall
|
|
|
|
it should encourage better long-term health of the app and give everyone more
|
|
|
|
confidence when making changes as coverage increases over time.
|
|
|
|
|
2021-04-23 18:46:08 +02:00
|
|
|
For changes guarded by a feature flag, we currently lean towards prioritising
|
|
|
|
our ability to evolve quickly using such flags and thus we will not currently
|
|
|
|
require tests to appear at the same time as the initial landing of features
|
|
|
|
guarded by flags, as long as (for new flagged features going forward) the
|
|
|
|
feature author understands that they are effectively deferring part of their
|
|
|
|
work (adding tests) until later and tests are expected to appear before the
|
|
|
|
feature can be enabled by default.
|
|
|
|
|
2020-03-13 15:38:04 +01:00
|
|
|
## Design and Product Review
|
|
|
|
|
2020-07-17 13:29:29 +02:00
|
|
|
We want to ensure that all changes to Element fit with our design and product
|
2020-03-13 15:38:04 +01:00
|
|
|
vision. We often request review from those teams so they can provide their
|
|
|
|
perspective.
|
|
|
|
|
|
|
|
In more detail, our usual process for changes that affect the UI or alter user
|
|
|
|
functionality is:
|
|
|
|
|
|
|
|
* For changes that will go live when merged, always flag Design and Product
|
|
|
|
teams as appropriate
|
|
|
|
* For changes guarded by a feature flag, Design and Product review is not
|
|
|
|
required (though may still be useful) since we can continue tweaking
|
|
|
|
|
|
|
|
As it can be difficult to review design work from looking at just the changed
|
2020-12-09 14:59:45 +01:00
|
|
|
files in a PR, a [preview site](./pr-previews.md) that includes your changes
|
|
|
|
will be added automatically so that anyone who's interested can try them out
|
|
|
|
easily.
|
2020-03-18 12:18:29 +01:00
|
|
|
|
|
|
|
Before starting work on a feature, it's best to ensure your plan aligns well
|
2020-07-17 13:29:29 +02:00
|
|
|
with our vision for Element. Please chat with the team in
|
2021-04-16 17:02:46 +02:00
|
|
|
[#element-dev:matrix.org](https://matrix.to/#/#element-dev:matrix.org) before
|
|
|
|
you start so we can ensure it's something we'd be willing to merge.
|