{"id":28,"date":"2021-11-05T16:04:16","date_gmt":"2021-11-05T16:04:16","guid":{"rendered":"http:\/\/v2202107152796158410.ultrasrv.de\/?page_id=28"},"modified":"2023-11-03T00:51:05","modified_gmt":"2023-11-03T00:51:05","slug":"evaluation-criteria","status":"publish","type":"page","link":"https:\/\/www.ecrts.org\/evaluation-criteria\/","title":{"rendered":"Evaluation criteria"},"content":{"rendered":"\n<p>In order to be reviewed, papers must be in scope (that is, adress some form of timing requirement) and follow the <a href=\"https:\/\/www.ecrts.org\/submission-instructions\/\" data-type=\"page\" data-id=\"29\">submission instructions<\/a>. Submissions are evaluated by the program committee according to the following criteria:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"#Contribution\">Contribution<\/a><\/li>\n\n\n\n<li><a href=\"#Originality\">Originality<\/a><\/li>\n\n\n\n<li><a href=\"#Correctness\">Technical correctness<\/a><\/li>\n\n\n\n<li><a href=\"#Writing\">Writing quality<\/a><\/li>\n<\/ul>\n\n\n\n<h5 class=\"wp-block-heading\" id=\"Contribution\">Contribution<\/h5>\n\n\n\n<p>We welcome theoretical and practical contributions to the state of the art in the design, implementation, verification, and validation of real-time embedded and cyber-physical systems. This includes case studies, implementations, tools, benchmarks, application scenarios, technology transfer success stories (or failures), and open problems.<\/p>\n\n\n\n<p>We particularly encourage papers on industrial case studies, the application of real-time technology to real systems, and system-level implementations. We believe that our community needs to validate the proposed assumptions and methodologies with respect to realistic applications. We welcome practical contributions even without novel theoretical insights, provided they are of interest to the research community and\/or industry. In such cases, authors should make an effort to provide proper motivation and justification of the relevance of their work and report on lessons learned.<\/p>\n\n\n\n<p><strong>The models, assumptions, and application scenarios used in the paper must be properly motivated.<\/strong><\/p>\n\n\n\n<p>Authors (of both practical and theoretical works) must demonstrate the applicability of their approach to real systems (examples of realistic task models can be found <a href=\"https:\/\/www.ecrts.org\/industrial-challenge\/\" data-type=\"page\" data-id=\"364\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a>). Deviations from such models or strong simplifications require justification. In particular, papers relying on simple models must have more fundamental theoretical insights than papers that include more details by construction, such as system-level implementations.<\/p>\n\n\n\n<p>Whenever relevant, we strongly encourage authors to present experimental results. These can be obtained on real implementations, from simulations, or via the use of data from case studies, benchmarks, or models of real systems. The use of synthetic workloads or models is permitted, but authors are strongly&nbsp;encouraged to properly motivate and justify the choices made in designing their synthetic evaluation.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\" id=\"Originality\">Originality<\/h5>\n\n\n\n<p>Authors are expected to\u00a0clearly explain the relationship between their work and the existing state-of-the-art (including their own prior work). In addition, they must, whenever relevant, compare their work with the state-to-the-art to show the size, scope, and significance of the improvements they have made. Experimental evaluations should cover a broad but realistic range of parameters. Authors should avoid selecting specific cases where there may be a bias in favor of their approach. As well as explaining the advantages of their new approach with respect to the state-of-the-art, authors should also give a balanced view of its disadvantages.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\" id=\"Correctness\">Technical correctness<\/h5>\n\n\n\n<p>Technical correctness is a mandatory requirement for acceptance. We consider it to be the duty of the authors to convince the reviewers of the technical correctness of their paper by whatever means the authors consider appropriate. We encourage open-source initiatives and computer-assisted proofs in order to increase confidence in practical and theoretical results and to improve their reusability. We acknowledge that due to IP constraints, implementation papers may not be able to provide all details. In this case, the authors should strive to provide sufficient information for the paper to remain of interest to the reader.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\" id=\"Writing\">Writing quality<\/h5>\n\n\n\n<p>The writing quality of the paper is very important. The paper must be well structured and clearly written to ensure that the reader can precisely understand and evaluate the technical contribution. We expect the authors to proofread their paper and to reduce the number of typos and grammatical mistakes. Note that concision is a hallmark of good academic writing; contribution is not judged based on the length of the submitted manuscript, and authors should not unnecessarily pad the paper to reach the page limit.<\/p>\n\n\n\n<p>Prospective authors can find <a href=\"https:\/\/www.ecrts.org\/suggestions-for-authors\/\">here<\/a> suggestions (which are not mandatory rules) for structuring and writing their paper that are likely to be appreciated by the reviewers.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In order to be reviewed, papers must be in scope (that is, adress some form of timing requirement) and follow the submission instructions. Submissions are evaluated by the program committee according to the following criteria: Contribution We welcome theoretical and practical contributions to the state of the art in the&#8230;<\/p>\n<p class=\"continue-reading-button\"> <a class=\"continue-reading-link\" href=\"https:\/\/www.ecrts.org\/evaluation-criteria\/\">Continue reading<i class=\"crycon-right-dir\"><\/i><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-28","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/www.ecrts.org\/wp-json\/wp\/v2\/pages\/28"}],"collection":[{"href":"https:\/\/www.ecrts.org\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.ecrts.org\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.ecrts.org\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ecrts.org\/wp-json\/wp\/v2\/comments?post=28"}],"version-history":[{"count":6,"href":"https:\/\/www.ecrts.org\/wp-json\/wp\/v2\/pages\/28\/revisions"}],"predecessor-version":[{"id":1547,"href":"https:\/\/www.ecrts.org\/wp-json\/wp\/v2\/pages\/28\/revisions\/1547"}],"wp:attachment":[{"href":"https:\/\/www.ecrts.org\/wp-json\/wp\/v2\/media?parent=28"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}