From mn.ifi.proposalfailures
Revision as of 11:46, 7 January 2021 by (talk | contribs) (blabla)

Jump to: navigation, search

These guidelines are derived as subjective interpretations of the reviewer statements on this page.

Excellence (the research idea itself, methods, ..)

Unclear, not enough detail, not ground-breaking enough:

    • The proposal also mentions analytic evaluations, but does not become specific there.
    • In a few cases, the concrete results, e.g., simulation model, prototype etc. are not given in sufficient detail.
    • The quantitative goals defined in the proposal seem realistic, but somewhat vaguely specified not very ambitious (20% improvement over state of the art does not seem a ground-breaking result, nor it is clear what metrics will be used to quantify the improvement).
    • The proposal can be strengthened though by better explaining its groundbreaking nature and generalisability.
    • The proposed research directions are clearly innovative, but the goals seem somewhat incremental rather than truly ground-breaking.
    • On the one hand, the existence of a solid set of initial results reduces the risk that the project fails in achieving its planned goals. On the other hand, though, it makes the proposal somewhat incremental, reducing its creativity and originality.
    • Some more details on how some of the questions are going to be tackled might have been useful.
    • Limited novelty due to the relatively small size of the community doing research around [..].
    • A lot of repetitions in the text because the research questions are somehow embedded in the objectives.
    • The scope of the project is very broad. Probably, each of these topics is a project on its own.

Problems with methods:

    • The scientific method limits itself to the experimental space, complementary analytic alternatives are not considered. Scientific achievements are expected more on experimental developments rather than on theoretical aspects.
    • Research methods are not well defined.
    • In some of the research activities related to the topics mentioned, quantitative research methods are missing.
    • Details on experimental evaluation are not sufficient.

Related work:

    • The proposal does not consider alternative Future Internet approaches.
    • How the project will differentiate from other approaches is not described in detail.
    • No adequate comparison to existing approaches.

Implementation (management)

PhD student supervision:

    • The project manager main research so far has been in the area of [different from proposal theme]. He has a strong experience in [..], but less so in [proposal theme]. More details regarding the supervision of PhD students should have been given in the proposal.
    • It is, however, not clear who will advise the researcher to be hired during Phase 1.

International cooperation:

    • This project is an international cooperation (..). However, the proposal does not provide much detail on how this international consortium will be managed.
    • It is not clear how they will collaborate in the project, but there is a plan of exchange visits and the intention to submit joint publications.
    • Most expertise [on security] lays in the external collaborators – this is a risk as the project investigations focus on this topic.

Other management issues:

    • The number of requested PhD students might be at the upper edge for this work.
    • No work package is dedicated to the integration of WP1 and WP2, the evaluation of the results, the project management and the dissemination, which can constitute a risk for the implementation.
    • The management structure is not sufficiently described.
    • The proposal is rather vague about the division of research tasks and responsibilities between team members.
    • The risk management plan appears to be quite generic and the mitigation actions do not appear to be so refined.
    • Work package structure highly simplified in a waterfall arrangement. The timeline and dependencies are not well identified.

Impact (dissemination, exploitation, ..)

  • Dissemination is rather standard, i.e. dissemination activities are mainly based on publications in journals and international conferences.
  • The technological impact is described, which is however not the case for the impact on / importance for society.
  • Outstanding impact on research community is not fully convincing in view of the reference list provided, since most of them are of the research team without a significant number of non self-cites.
  • There is a lack of KPIs for dissemination activities.
  • Also, the potential exploitation of the research results is not addressed.
  • But there is a lack of information about contacts to standardisation channels.
  • Better explaining how this project will generate impact on Internet standards would strengthen the proposal.
  • Ethics, safety and gender issues are not explicitly detailed in the proposal.
  • The whole impact description appears to be detailed but quite generic.