Evaluating RSE performance

[tscheypidi]

To establish transparent career paths for RSEs, indicators are needed for performance evaluation which go beyond the classical publication focused measures such as publications per year, i10 or H index.

How should RSE performance best be evaluated and what could be appropriate indicators to measure it? Can we come with a set of suggested indicators for the measurement of RSE performance?

[pancetta]

Hi @tscheypidi, thanks a lot for your proposal, excellent topic! As we're (slowly) moving toward more specific submissions, could you please add more details to the proposal? How would you organize such a session? Do you already have collaborators/contributors in mind? We'd also need a short abstract and 1-3 people responsible for running the session.

[tscheypidi]

Hi @pancetta,

I thought of this session as an open discussion round, potentially split in the first part into smaller discussion groups (depending on the number of participants). Session can probably be rather short. Outcome of this session should be a list with potential indicators to evaluate RSE performance. Currently, I do not have any specific collaborators in mind but are open for constributions.

As abstract you could use the following:

This discussion session will explore the need for alternative indicators to evaluate the performance of RSEs. While classical measures such as publications per year, i10, or H-index are well-established, they do not accurately reflect the unique skills and contributions of RSEs. Participants will discuss potential indicators to evaluate RSE performance and work towards creating a list of suggested measures. The session will be an open discussion, with the possibility of splitting into smaller groups depending on participant numbers. The outcome of the session will be a list of potential indicators to evaluate RSE performance, which will help establish transparent career paths for RSEs.

[pancetta]

Hi again! How long do you think the BOS should be? We plan with slots of 90 minutes with the default length of one slot.

[tscheypidi]

90 minutes should be sufficient

[HeidiSeibold]

Potentially relevant: https://coara.eu/

[HeidiSeibold]

I added a label to this break-out. Can you check if you feel it is appropriate and change it if not? Let me know if you have any questions.

[HeidiSeibold]

@tscheypidi please check if the following is ok for you. Do you need any more collaborators?

Who could be interested in collaborating on this?

(feel free to tag them with their GitHub username if they have one)
@tscheypidi

How much time do you need for this?

90 minutes

Abstract

This discussion session will explore the need for alternative indicators to evaluate the performance of RSEs. While classical measures such as publications per year, i10, or H-index are well-established, they do not accurately reflect the unique skills and contributions of RSEs. Participants will discuss potential indicators to evaluate RSE performance and work towards creating a list of suggested measures. The session will be an open discussion, with the possibility of splitting into smaller groups depending on participant numbers. The outcome of the session will be a list of potential indicators to evaluate RSE performance, which will help establish transparent career paths for RSEs.

[tscheypidi]

@HeidiSeibold thanks for this. Looks good. I would be happy to have 1-2 more people join the team, but probably can also organize the session alone if nobody else is interested in setting it up.

[pancetta]

Hi! I just added the "Accepted" label to this BOS. Welcome on board!
https://un-derse23.sciencesconf.org/program

[pancetta]

Hi all, the unconference is only 3 weeks away now! On day 1 there will be a breakout blitz where all session organizers should advertise their sessions. 1 minute, 1 slide, let people know what you intend to do. Please prepare this slide in advance and add it right here (PDF please), by September 20.

[tscheypidi]

Here is my teaser slide:
evaluatingRSEperformance.pdf

[pancetta]

Here is the main hub for taking notes: https://pad.gwdg.de/FkFJTslFQhq-UF3Es6q4rw#

[pancetta]

Have fun with the session(s)! Please add the pad you're using also here for people to see what you did.

If possible, please prepare a 1 minute wrap up of your session for the farewell session on Thursday afternoon! What did you do in the session, how would you like to continue, how can people contribute after the unconference etc. We'll go through the blitz slides again one by one as in the blitz session.

[tscheypidi]

Pad: https://pad.gwdg.de/ghuWQ2E9Tomo19Cwe67aXw