Changelog

Changelog

36min

Echoes is released continuously, our changelog is therefore an arbitrary month-to-month aggregation of changes.

November

Added
Workstreams
Added
Exclude contributions from effort computation
Added
Shortcut label cascading


Workstreams

Workstreams is the ability for you to pick any work item that already exists in your product-development tools (e.g., a JIRA EPIC) and supercharge its tracking with Echoes. Simply adding a workstream to Echoes gives you:

  • Automatic risk identification with insights.
  • Allocation measurement (how teams are allocating their effort against this workstream, and which teams are contributing to it).
  • Forecasts, and estimated date of completion.
  • DORA metrics.

The list of selected workstreams is individual, meaning that an engineering manager can chose to follow closely a set of Stories, when a director can chose to follow a handful or larger EPICs.

Exclude contributions from effort computation

In certain cases you don't want a GitHub Pull Request or GitLab Merge Request to be accounted for in the effort computation, for example because it was fully automated, or didn't require any time from the team.

For this purpose the echoes/effort: none label can now be used to exclude a code contribution from the efforts computation. It will however continue to appear in your listings, and contribute to other computations such as the DORA.

Shortcut label cascading

Labels added to a Shortcut EPIC now automatically cascade down to all GitHub Pull Requests and GitLab merge requests referencing the EPIC through Stories links. This is particularly useful for new users who want the ability to categorize the history with as few manual actions as possible.

September

Improved
JIRA labeling behavior
Improved
Pull requests insights auto-expiration


JIRA labeling behavior

We have clarified our labeling automations with JIRA to minimize confusion. In particular, newly opened tickets will not get the value of their "Echoes - Intent" custom field automatically set based on their parent's. This created confusion, especially as a ticket got removed from an EPIC or moved to a different EPIC, but kept the value of its "Intent" field.

This change is not expected to have any impact for our users. GitHub pull requests and GitLab merge requests referencing tickets continue to get their label automatically set based on the "Echoes - Intent" field of the ticket they reference, and any of its parents.

See the JIRA integration page for more details.

Pull requests insights auto-expiration

Some insights are time-sensitive, in particular those that directly apply to a particular Pull Request (for example to alert that it is stuck in review). These insights would remain open until they expired after 14 days, or needed to be manually dismissed.

Insights linked to a particular Pull Request will now automatically expire when that Pull Request gets merged or closed, to save you a few clicks.

August

Added
[Beta] Initiative aggregated status
Added
[Insight] An initiative won't be completed on time
Added
[Insight] Progress on an initiative is slowing down
Added
[Insight] Initiative scope grows faster than its completion
Improved
Improved initiatives forecast


[Beta] Initiative aggregated status

A refreshed initiative report now presents an aggregated status for the project, based on all identified risks.

Identified risks for a project
Identified risks for a project


[Insight] An initiative won't be completed on time

This new insight alerts when an initiative estimated time of completion is beyond its configured target completion date. This computation is based on the current pace of progress (i.e., completion of its scope as captured through issues across integrations).

[Insight] Progress on an initiative is slowing down

This new insight alerts when progress on an initiative is slowing down, i.e. when our pace or progress is falling behind the estimated forecast.

[Insight] Initiative scope grows faster than its completion

This new insight alerts when the scope of an initiative grows faster than its completion. This insight can detect situations where we are making progress, yet the target keeps moving further.

Improved initiatives forecast

We have upgraded our engine to forecast the completion of initiatives. This vastly improved model now feeds into several new insights.

Document image


June

Added
Linear publication filter
Improved
Exclude zeros from Slack and Teams weekly reports


Linear publication filter

Add the ability to publish categories and initiatives to specific Linear teams. Learn more about this feature in Scoped publication.

Exclude zeros from Slack and Teams weekly reports

The weekly Slack and Microsoft Teams allocation reports now excludes lines without any activity to accomodate for users with a high number of categories of work, but with teams that only contribute to a handful of them all.

May

Added
[Beta] Microsoft Teams support
Added
[Metrics] Per-repository metrics


[Beta] Microsoft Teams support

Echoes is now supporting Microsoft Teams to send weekly, daily and insights reports!

Weekly report Weekly report in Microsoft Teams
Weekly report in Microsoft Teams


This feature is an early release and currently in beta: reach out if you'd like to start using it for your organization!

[Metrics] Per-repository allocation

Echoes now provide a new Raw Metrics to expose (development) effort allocations on a per-repository basis.

per-repository breakdown of effort allocation
per-repository breakdown of effort allocation


The same metrics also allows combining other breakdowns such as the GitHub or GitLab labels. Hence complementing the dashboards you already get from Echoes labels.

per-repository and per-Github label effort allocation
per-repository and per-Github label effort allocation


April

Improved
Insights report
Improved
Reference JIRA ticket through PR/MR body
Improved
Team report: better DORA display
Added
[Insight] High amount of context switch
Added
[Insight] The allocation on maintenance is increasing
Added
[Metrics] New metrics


Insights report

As Echoes' catalog of insights grows, more of you have asked to understand which alerts are implemented but have not occured within their teams. We reworked the insights reports in this direction, to present both the actions taken over the selected period, as well as the full catalog of insights along with the "hits".

Document image


Reference JIRA ticket through PR/MR body

Echoes will now inspect the body of GitHub Pull Requests and GitLab Merge Requests to find a JIRA issue key. When such link is found, it is used to automatically label the contribution based on the value of the "Echoes - Intent" JIRA Custom Field, as well as in some metrics (e.g., the Lead time).

This change comes in addition to the previously implemented JIRA guidelines to reference a ticket from a GitHub Pull Request or a GitLab Merge Request. Referencing a JIRA ticket through the contribution's title, branch name, and commit message headline remains supported.

Team report: better DORA display

Rework of the Deployments Frequency and Change Failure Rate views for better introspection on the team report

Deployments frequency
Deployments frequency


[Insight] High amount of context switch

Ad-hoc requests, unclear requirements or scope creep can force developers to abruptly switch context. This new insight analyzes the work from the team and pinpoints which contributions are subject to abnormal context switch.

[Insight] The allocation on maintenance is increasing

High maintenance may be an indicator that some refactoring, technical or process improvement becomes necessary for the sustainability of services. This new insight notifies you when a team's maintenance burden increases compared to its historical trend.

[Metrics] New metrics

Some metrics have been added to the "Raw data":

  • Change failure count
  • Deployments count
  • Pickup time: the delay between a GitHub Pull Request or GitLab Merge Request being ready for review, and another member commenting or reviewing the code change

March

Added
Insight: Slack notifications
Added
Insight: links to the underlying metric
Added
[Insight] The number of in-progress tasks is unusually high
Added
[Insight] A contribution is slower than unusual


Insight: Slack notifications

Stay on top of Echoes insights with notifications directly into Slack.

Document image


Insight: links to the underlying metrics

Insights are an opinionated analysis of one aspect of the team's activity. In some cases, you may want to examine the underlying signal and understand its trajectory over time, or how it differs with other team.

More insights now link their underlying metric, so that you can dig into the data, freely change the filters or the timeframe, and compare teams.

Insight link to the underlying metric
Insight link to the underlying metric


Note all inputs to our insights are currently exposed as standalone metrics. If there's a metric you'd like to see added, please reach out.

[Insight] The number of in-progress tasks is unusually high

This new insight analyzes the number of in-progress tasks for your team, and can alert when it's either abnormally high considering the number of contributors, or when it departs from the team's historical average.

Document image


[Insight] A contribution is slower than unusual

This new insight analyzes individual GitHub pull requests and GitLab merge requests to detect when the progress in any given phase of the development process is below the team's historical trend.

Insight: a contribution is slower than unusual
Insight: a contribution is slower than unusual


February

Added
Slack: exclude drafts from daily reports
Improved
Effort allocation computation change
Improved
GitHub checks reported status


Slack: exclude drafts from daily reports

The daily Slack report sends, on the team's channel, the list of GitHub pull requests or GitLab merge requests grouped by status. It is now possible to exclude draft items from thist list to reduce the length of the message.

Slack notification settings
Slack notification settings


This new option can be found in your team's integrations settings.

Effort allocation computation change

Echoes is committed to give you the best insights and dashboards with a seamless experience. We continuously assess how users integrate Echoes in their workflow and how they interact with Echoes features. We are changing the default-weight given to unlabelled GitHub Pull Requests, or Merge Requests in GitLab.

Starting February 20th 2024, GitHub Pull Requests and GitLab Merge Requests will be considered "XS" rather than "M" by default. No action is expected from existing users.

See Feb 24: default weight change for a full description of the change.

GitHub checks reported status

The GitHub check for labels now reports success instead of "skipped" for situations where the pull request's author either doesn't belong to any team from Echoes perspective, or belongs to a team where labels are not enforced.

This allows to enforce the labels checks through GitHub branch protection rules, including on shared repositories where multiple teams with different label enforcement contribute.

Document image


January

Added
Insights
Added
Low-level metrics


Insights

Your mission as an engineering leader is to help your teams live up to their full potential. Our mission as a company is to support you in that complex, but fascinating, task. Today, we are taking a major step in this direction with the launch of Echoes Insights.

Insights home
Insights home


Echoes goes beyond data collection and reporting by analyzing your data for you, to become your engineering manager's copilot. Insights shines a light on the weak signals that may require your attention, such as:

  • A high amount of cross-teams dependencies?
  • A spike in the number of issues being filed on one of your team's projects?
  • A team member who seems to be working an alarming number of consecutive days
  • ... and a growing number of other signals to help you maximize your team's impact, sustainably.
Example insight (1)
Example insight (1)

Example insight (2)
Example insight (2)


This is an early release, and we have ambitious plans to enrich the catalog of insights in the upcoming months, in no small part based on your feedback! Book time to discuss, or to let us know what you think via the feedback module in Echoes.

Low-level metrics

Insights are a high-level abstraction producing a summarized analysis of a combination of low-level metrics. Echoes now exposes the catalog of low-level metrics in order for you to better understand and explore the activity of your teams.

Document image


With this feature, Echoes gives you access to three different layers of engineering data:

  • Metrics, the low-level measurements such as the allocation of efforts of one team against a particular category of work (e.g., maintenance in the screenshot above).
  • Reports, which arrange topically-connected metrics in a readily-usable format.
  • Insights, which find and surface the valuable signal from the sea of metrics.

Archive

Updated 15 Nov 2024
Did this page help you?