<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[OnlineS3 Consultation - Medium]]></title>
        <description><![CDATA[Consultation on the available strategic planning methodologies that are applicable in the development, implementation and monitoring of Research and Innovation Strategies for Smart Specialisation (RIS3). - Medium]]></description>
        <link>https://medium.com/onlines3-consultation?source=rss----9423a192ea09---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>OnlineS3 Consultation - Medium</title>
            <link>https://medium.com/onlines3-consultation?source=rss----9423a192ea09---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Fri, 20 Nov 2026 15:06:52 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/onlines3-consultation" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[6.1. RIS3 monitoring]]></title>
            <link>https://medium.com/onlines3-consultation/6-1-ris3-monitoring-7ca82bd9d4e8?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/7ca82bd9d4e8</guid>
            <category><![CDATA[monitoring-and-evaluation]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Tue, 20 Dec 2016 12:07:53 GMT</pubDate>
            <atom:updated>2016-12-20T12:07:53.415Z</atom:updated>
            <content:encoded><![CDATA[<h4>The method will define the overall process/roadmap for RIS3 monitoring, which usually encompasses all sorts of activities that relate to the collection and processing of information about the achievement of expected results and the degree of implementation of policy measures.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/1*XdBXJDYJT7dHzoG4xU1gwg.png" /></figure><p>This method defines the overall process / roadmap for RIS3 monitoring, which usually encompasses all sorts of activities that have to do with the collection and processing of information about the achievement of expected results and the degree of implementation of policy measures.</p><p>A recent definition of monitoring is presented by Gianelle and Kleibrink (2015), stating that monitoring usually encompasses all sorts of activities that have to do with the collection and processing of information regarding the achievement of expected results and the degree of implementation of policy measures. Given the above, the investigation and design of both monitoring and evaluation processes taking place throughout the implementation of RIS3 projects is a crucial step. M&amp;E must be properly organised and designed in detail for the implemented activities to achieve the highest possible socio-economic impacts.</p><p>Monitoring is an integral part of RIS3, and to receive Structural Funds assistance, all regions are required to develop tailored monitoring. The mapping exercised showed that detailed RIS3 M&amp;E frameworks are currently in development in many regions, and that there is a great interest in inter-regional experience exchanges on this aspect of smart specialisation design.</p><h3>Description of the method</h3><p>Three main purposes referring to the utility of RIS3 monitoring mechanism should be highlighted here (Kleibrink et al., 2016). First, learning-and-acting is one of the core purposes of monitoring process, indicating the need for policy makers to be well informed of the reality conditions and the risks of failing, as well as the development of a learning system for participants. Second, trust-building amongst stakeholders and citizens, is another important dimension of monitoring processes. This characteristic should be accompanied by motivation, commitment and aversion to report failure. Last but not least, accountability is considered to be an integral part of this mechanism, built on clear rules for counting/measuring and bottom layer auditing.</p><p>In general, monitoring can be effectively interpreted in combination with the general RIS3 context, due to its strong connection with the RIS3 strategy structure. This means that depending on the diversified characteristics of the various RIS3 strategies that are implemented in EU countries, monitoring can take different forms. Furthermore, given the fact that monitoring can be regarded as an information gathering mechanism, one of its main utilities is to constitute a base upon which a periodic refinement and refocusing could be made.</p><p>Under this perspective, in order to design the monitoring system for a RIS3 strategy, it is important to understand in detail the mechanism lying behind it. Following the work of Gianelle and Kleibrink (2015), we can acknowledge the existence of three main discrete stages that constitute the main pillar of a RIS3 intervention logic: (i) recognition of challenges and needs; (ii) formulation of vision statement and strategic objectives; and (iii) selection of envisaged solutions to achieve these strategic objectives. The interconnections between these stages are shown clearly in Figure 1.</p><p>The complexity arising from the implementation of RIS3 strategic interventions within a country becomes clear when looking at Figure 1 below. Focusing on the schematic representation of the RIS3 implementation process, it is important to highlight that moving from phase 2 to phase 3 constitutes a crucial step, as it denotes the transition from the general to the more specific part of the planning procedure. During phase 3, the selection of the “means” (levers — E.1) that will be used to achieve the desirable “ends” (goals) referring to specific socio-economic areas (E.2) will ultimately define the set of priorities that will be determined.</p><p>Having chosen a specific set of priorities it is then possible to define explicit variables and indicators, which could be used to measure the expected change made by the selected levers on the targeted socio-economic areas of intervention. More specifically, according to Gianelle and Kleibrink (2015) expected change is defined by: (i) a variable of socio-economic nature; (ii) a set of baseline and target values; and (iii) a timeframe for variable observation. The identification process of the expected change measures therefore sets the foundation of the M&amp;E systems. As a result, it becomes evident that the design for a well-organised and effective M&amp;E mechanism is considered to be an integral part of the whole strategic RIS3 planning process.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/542/1*15UqslmwNW35UheKOO7CvA.png" /><figcaption>Figure 1: The RIS3 structure (Source: Gianelle and Kleibrink (2015, p.6))</figcaption></figure><h3>Usability and impact</h3><p>The monitoring and evaluation (M&amp;E) system is considered to be an important part of the overall governance system, alongside budget, human resources and auditing systems (Kusek &amp; Rist, 2004). Its main contribution is to provide an analytical feedback system regarding the outcomes, impacts and effects of the implemented policies and programs.</p><p>According to the World Bank (2016) there are two key mechanisms through which monitoring and evaluation (M&amp;E) can affect the effectiveness of the implemented projects. First, M&amp;E provides crucial evidence with respect to the degree to whicih each project achieves its goals, and its results comparative to the target values. Secondly, there is evidence throughout literature (Legovini, Di Maro and Piza, 2015) that M&amp;E can affect the overall quality of project supervision and implementation, resulting in higher quality outputs.</p><p>Monitoring and evaluation are considered to be intrinsically interdependent, as the results derived from monitoring exercises include all the information needed to perform an evaluation analysis (Kleibrink et al., 2016). Monitoring by itself constitutes an early warning system, in cases of ineffective or even bad implementation of policy measures or actions. Thus, it is crucial to develop a design process that could provide the policy-makers with the ability to effectively choose indicators for monitoring. The more proper indicators are chosen, the better the results of their transformation into interventions to the already implemented policies and projects will be.</p><p>EU regional cohesion policy shift towards the smart specialisation framework requires a similar change in the way the monitoring process is implemented. According to Farole et al. (2011), under this new policy context, in order to improve the delivery and effectiveness of the intervention, better and leaner monitoring procedures should be included.</p><h3>Required data</h3><p>Policy makers define the data needs,, as they decide which indicators and databases will be used for the monitoring of the implemented policies. However, potential data sources for this method that could be used include Eurostat database, as well as regional and national reports. The frequency of the monitoring process should not be ignored when choosing the appropriate databases, as data availability, especially at a regional level, is in many cases restricted.</p><h3>Relevant data sources</h3><p>The data sources for the implementation process are not yet available, as the process by itself requires data collection throughout the period when the action programmes are being implemented.</p><h3>Implementation roadmap</h3><p>Regarding the structure of the application that could support this methodology, there are some key features that should be applied throughout it. As it is shown in Figure 3, the collection of new or already existing data during the data selection process will be used as input for the development of intermediate reports throughout the implementation process. Therefore, the results arising from these intermediate reports will lead to corrective policy measures, increasing the effectiveness of the implemented actions.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/509/1*CipCw710EWrYbaInylg1-g.png" /><figcaption>Figure 2 Steps of implementation of the monitoring process</figcaption></figure><h3>References</h3><ul><li>Alexander Kleibrink, Carlo Gianelle &amp; Mathieu Doussineau (2016) Monitoring innovation and territorial development in Europe: emergent strategic management, European Planning Studies, 24:8, 1438–1458, DOI: 10.1080/09654313.2016.1181717</li><li>Farole, T., Rodríguez-Pose, A., &amp; Storper, M. (2011). Cohesion policy in the European Union: growth, geography, institutions. JCMS: Journal of Common Market Studies, 49(5), 1089–1111.</li><li>Gianelle, C., &amp; Kleibrink, A. (2015). Monitoring Mechanisms for Smart Specialisation Strategies. S3 Policy Brief Series, (13).</li><li>Kusek, J. Z., &amp; Rist, R. C. (2004). Ten steps to a results-based monitoring and evaluation system: a handbook for development practitioners. World Bank Publications.</li><li>Leeuw, F. L., &amp; Furubo, J. E. (2008). Evaluation Systems What Are They and Why Study Them? Evaluation, 14(2), 157–169.</li><li>Legovini A., Di Maro, V. Piza C. (2015) Impact Evaluation helps Deliver Development Projects. World Bank Policy Research Working Paper 7157.</li><li>Raimondo, E. (2016) What Difference Does Good Monitoring &amp; Evaluation Make to World Bank Project Performance? World Bank Policy Research Working Paper 7726.</li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7ca82bd9d4e8" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/6-1-ris3-monitoring-7ca82bd9d4e8">6.1. RIS3 monitoring</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[6.2. Definition of RIS3 output and result indicators]]></title>
            <link>https://medium.com/onlines3-consultation/6-2-definition-of-ris3-output-and-result-indicators-cd9f389a8ec3?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/cd9f389a8ec3</guid>
            <category><![CDATA[monitoring-and-evaluation]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Mon, 19 Dec 2016 21:19:42 GMT</pubDate>
            <atom:updated>2016-12-19T21:19:42.157Z</atom:updated>
            <content:encoded><![CDATA[<h4>Output and result indicators constitute an essential part of RIS3 monitoring and evaluation.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/1*lL0zypYdoJSTqJbsL_QIyw.png" /></figure><p>Output and result indicators constitute an essential part of a more general RIS3 step, focusing on monitoring and evaluation. Output and result indicators are the main instruments of monitoring and evaluation processes, and try to capture the effectiveness of the implemented programs’ performance. The definitions for each one of these two kinds of indicators are given below. According to the European Commission (2015, p.7):</p><ul><li><em>Output indicators</em> relate to operations supported. An output is considered what is directly produced/supplied through the implementation of an ESF operation, measured in physical or monetary units. Outputs are measured at the level of supported people, supported entities, provided goods or services delivered. They are set at the level of investment priorities or specific objective.</li><li><em>Result indicators</em> capture the expected effects on participants or entities brought about by an operation. Result indicators shall correspond to the specific objectives set out for each investment priority selected. Result indicators go beyond output indicators in so far as they capture a change in the situation, in most cases related to supported entities or participants.</li></ul><p>Given the fact that output and result indicators are the main tool for performing monitoring and evaluation activities, it is important to better understand the main concept of these two processes, for effectively choosing the appropriate indices in each case. At the same time, the fact that RIS3 strategic planning has turned out to be a fundamental ingredient of policy making process within EU, indicates the need to adjust M&amp;E mechanisms and thus, the specification of output and result indicators under this framework.</p><p>A list of the regions that have applied this method in RIS3 strategies includes: Northern Ireland, Central Portugal, Mazowieckie (PL), Zuid-Holland and Noord-Holland (NL) and many others. The mapping exercised indicated that the definition of output and outcome indicators has been applied in 90% of regions, while more structural change and context indicators have been set by some 70% of regions.</p><h3>Description of the method</h3><p>According to the European Commission (2014) it is important to have a common set of guidelines that will enable the project managers to effectively implement the chosen programs under the RIS3 framework. Based on this fact, the identification process of output and result indicators should follow a specific set of criteria, that will maintain the quality of the monitoring and evaluation processes.</p><p>More specifically, these indicators should be: i) responsive to policy; ii) normative; iii) robust; and iv) they should be available to be collected or calculated over time. For each of them a baseline value should also be required, in order to make comparisons and evaluations of the implemented policies. It is essential to note that before identifying the output and result indicators, a set of targets and priorities shall be established, under the RIS3 framework. The selection of the appropriate indicators will then be based upon these more general targets.</p><p>As it is stated, the result indicators are the expression of the objective of an investment priority (European Commission, 2014). At the same time, output indicators should be program specific and should be derived from the intervention logic of the program. This is a crucial difference between these two kinds of indicators, as it implies that for the case of output indicators, there is no need for setting baseline values. This means that the baseline in these cases is zero (Kokkinoplitis et al., 2015).</p><p>Finally, in order to further promote the use of high quality indicators, that could additionally provide the possibility of performing regional comparisons, a set of common indicators has been proposed by the European Commission. These indicators have standard definitions and units of measurement across different countries, when being used for measurement throughout Operational Programs. Thus, it is also possible to aggregate the results to higher spatial levels of analysis, such as national and EU.</p><h3>Usability and impact</h3><p>EU regions are using different types of indicators to capture the impact of RIS3. The use of a common system of indicators will provide meaning to the data and enable benchmarking of the performance and efficiency of policy measures.</p><p>The choice of output and result indicators is implemented based on a set of already defined objectives and priorities, interconnected with the general concept of well-being and progress of people. After having identified the desirable results and targets for each program, the specification of proper variables that would enable a valid measurement of the program’s effectiveness is an essential procedure.</p><p>In general, it is important to define highly appropriate output and result indicators, in order to be able to specify and analyse any possible problems that might arise during the implementation process of the programs. All the available information deriving from these indicators, then will be used for understanding the problems and finding solutions to adjust the implemented policies, in order to meet the desirable target values (European Commission, 2014). It is important to note that output indicators are derived as direct effects of the programs, contributing to the further composition of the result indicators, that try to measure the effectiveness of the implemented policies, in terms of wider objectives.</p><p>Under this concept and based on previous research (Ekins &amp; Medhurst, 2006; European Commission, 1999), Figure 1 illustrates a diagram produced by the European Commission (2014, p.5), which tries to depict more specifically the use of output and result indicators. As it is shown in this diagram, the achieved outputs are used as an input for measuring each program’s contribution/impact to the overall actual result of the implemented policy. The achieved outputs are measured via output indicators, whilst the actual result is defined by the synthesis of the result indicators. One of the most crucial parts of this process is the definition of the baseline and target values for each one of these variables.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*3AWhBTdgsl7B0DVBv7of1g.png" /><figcaption>Figure 1 Diagram illustrating the main idea for an effective use of output and result indicators. (Source: European Commission (2014))</figcaption></figure><p>Also important, is the fact that other additional factors exist and act during the implementation of the programs, affecting their final actual results. Thus, it is essential that throughout the evaluation process, a distinction between these additional factors and the contribution of policy interventions be made. This can be represented schematically as follows (European Commission, 2014):</p><blockquote>Change in result indicator = contribution of intervention + contribution of other factors</blockquote><p>According to Nauwelaers and Wintjes (2008) the evaluation process should also play a key role to understand the ways in which complex innovation policy systems operate. Although, evaluation systems were traditionally considered to have an ex post character, there is evidence that they can also be used for improving the design of innovation policies in real time (Magro &amp; Wilson, 2013). Thus, the development and use of proper output and result indicators could work as a propulsive force towards the further development of these policies.</p><h3>Required data</h3><p>Data for calculating these indicators are available from EUROSTAT, at a national or regional level, for specific time periods. Another indicative example of defining the appropriate indicators for monitoring and evaluating the results of the implemented policies is also presented in the case of the Horizon 2020 strategy by the European Commission (2015).</p><h3>Relevant data sources</h3><p>A valuable source of information regarding the potential variables that can be used as output and result indicators is the List of Common indicators published by the European Commission in 2014. This list provides a comprehensive set of indicators that can be used for monitoring and evaluation, as long as their definitions.</p><p>According to the European Commission (2014), the 46 proposed common indicators are grouped based on 10 wide areas of interest: (1) productive investment; (2) ICT; (3) Transport; (4) Environment; (5) Research Innovation; (6) Energy and Climate change; (7) Social infrastructure; (8) Urban Development specific indicators; (9) ETC specific indicators; and (10) Labour market and training.</p><h3>Implementation roadmap</h3><p>An analytical roadmap regarding the steps that should be followed before and after the selection of output and result indicators is given below (<strong>Figure 2</strong>). As it can be seen, the selection of challenges and the specific actions that will be used for their implementation constitute essential prior steps to the definition of indicators.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/938/1*cVyO7FkoT9VL2h81C0CZXw.png" /><figcaption>Figure 2 Roadmap for the selection of output and result indicators for monitoring and evaluation</figcaption></figure><h3>References</h3><ul><li>Ekins, P., &amp; Medhurst, J. (2006). The European Structural Funds and Sustainable Development A Methodology and Indicator Framework for Evaluation. <em>Evaluation</em>, <em>12</em>(4), 474–495.</li><li>European Commission. (2015) Guidance document on monitoring and evaluation of European cohesion policy. The programming period 2014–2020. Brussels, June 2015. Available at <a href="http://www.esf.ie/en/ImageLibrary/Repository/Files/Monitoring-Evaluation-Guidance-June-2015.pdf">http://www.esf.ie/en/ImageLibrary/Repository/Files/Monitoring-Evaluation-Guidance-June-2015.pdf</a>.</li><li>European Commission. (2015) Horizon 2020 indicators: Assessing the results and impact of Horizon. Brussels, 2015. Available at <a href="https://ec.europa.eu/programmes/horizon2020/en/news/horizon-2020-indicators-assessing-results-and-impact-horizon">https://ec.europa.eu/programmes/horizon2020/en/news/horizon-2020-indicators-assessing-results-and-impact-horizon</a></li><li>European Commission. (2014) Guidance document on monitoring and evaluation. The programming period 2014–2020. Brussels, March 2014. Available at <a href="http://ec.europa.eu/regional_policy/sources/docoffic/2014/working/wd_2014_en.pdf">http://ec.europa.eu/regional_policy/sources/docoffic/2014/working/wd_2014_en.pdf</a>.</li><li>European Commission. (1999) Indicators for Monitoring and Evaluation: An Indicative Methodology. Working Paper 3 in The New Programming Period: 2000–2006: Methodological Working Papers. Brussels: EC. Available at <a href="http://europa.eu.int/comm/regional_policy/sources/docoffi%20c/working/doc/indic_en.pdf">http://europa.eu.int/comm/regional_policy/sources/docoffi c/working/doc/indic_en.pdf</a>.</li><li>Kokkinoplitis, K., Komninos, N., &amp; Tsipouri, L. (2015) RIS3 monitoring indicators and assessment system. Report (non-paper) for the European Union, December 2015.</li><li>Magro, E., &amp; Wilson, J. R. (2013). Complex innovation policy systems: Towards an evaluation mix. <em>Research Policy</em>, <em>42</em>(9), 1647–1656.</li><li>Nauwelaers, C., &amp; Wintjes, R. (2008). <em>Innovation policy in Europe</em>. Edward Elgar Publishing.</li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=cd9f389a8ec3" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/6-2-definition-of-ris3-output-and-result-indicators-cd9f389a8ec3">6.2. Definition of RIS3 output and result indicators</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[6.3. Balanced scorecard]]></title>
            <link>https://medium.com/onlines3-consultation/6-3-balanced-scorecard-f930b6416945?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/f930b6416945</guid>
            <category><![CDATA[monitoring-and-evaluation]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Mon, 19 Dec 2016 21:07:41 GMT</pubDate>
            <atom:updated>2016-12-19T21:07:40.596Z</atom:updated>
            <content:encoded><![CDATA[<h4>Balanced scorecard is a strategic planning and management system that is used extensively in business and industry, government, and non-profit organisations worldwide.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/1*T9eZih3FhbZQvURuSeBEGg.png" /></figure><p>The Balanced Scorecard (BSC) is a planning and management system that is widely used in a variety of areas in the private and public sector, with the aim of ensuring that the activities of an organisation are in line with its vision and strategy, improving internal and external communications, and monitoring organization performance against strategic goals. The idea behind the original balanced scorecard was that it provided a performance measurement framework that added “strategic non-financial performance measures to traditional financial metrics to give managers and executives a more ‘balanced’ view of organisational performance” (Balanced Scorecard Institute, n.d.- a).</p><p>However, the BSC has developed over the years and the so called “new” balanced scorecard aims to transform an organization’s strategic plan from a passive tool into an active tool for an organization on a daily basis. In other words, the balanced scorecard will help planners to identify what should be done and how it should be measured.</p><p>The BSC enables organizations to clarify their vision and strategy, and translate them into action. At the same time it provides feedback regarding both the internal business processes and external outcomes in order to continuously improve strategic performance and results. (Balanced Scorecard Institute, n.d.- a)</p><p>The value of the BSC is that it transforms a strategy into a continuous process owned by every employee, not just top managers, and enables organizations to communicate high-level goals down through all levels such that employees not only know what to do, but also why they are doing it (Kaplan &amp; Norton, 2004).</p><p>According to Kaplan &amp; Norton (2004), what makes the balanced scorecard (BSC) special is that it:</p><ol><li>Is a top-down reflection an organisations mission and strategy</li><li>Is forward looking</li><li>Integrates internal and external measures</li><li>Helps organisations to focus.</li></ol><p>This method would be useful to RIS3, as it would allow the effects of specific strategies to be traced, determine how they are helpful or where they are lacking by implementing measurements to strategy objectives, based on the views of the stakeholders involved and customers affected, and improve on them in the future, in order to achieve a broader improvement in performance taking into account a wider framework that does not include financial performance.</p><p>However, it should be noted that there is a difference in approach between a private versus public balance scorecard (see “Description of the method”). Furthermore, there is also the <strong>Public Sector Scorecard (PSS),</strong> which has been developed from the due to the argument that the BSC still fails to measure important outcomes in the public and third sector organisations.</p><p>The mapping exercise showed that around 23% of selected regions have employed some elements of balanced scorecard in RIS3 monitoring and evaluation process. Among the most elaborate approaches would be Lower Austria, where the tailored balanced scorecard methodology ARISE was employed.</p><h3>Description of the method</h3><p>In a broader view, Rohm (2002), currently President &amp; CEO of the Balanced Scorecard Institute, describes the BSC as:</p><ul><li>A strategic performance management system for the whole organization</li><li>A communications tool to make strategy clear to everyone</li><li>A way to balance financial and nonfinancial views of organization performance</li><li>A journey</li><li>A system for increasing accountability</li><li>A commitment to change</li><li>A way of aligning organization vision with human and capital resources, and with day-to-day operations.</li></ul><p>As a method the Balanced Scorecard (BSC) proposes to take a view on (private) organizations from four perspectives, and to develop metrics, collect data and analyze it relative to the following perspectives:</p><ul><li>The Learning &amp; Growth Perspective</li><li>The Business Process Perspective</li><li>The Customer Perspective</li><li>The Financial Perspective.</li></ul><p>This is presented in a four box model (see graphic “Private Sector View” in Figure “Private versus Public Sector Scorecard”). As mentioned under “Background and rationale” BSC has developed throughout the years and the four box model now includes also a Strategy Map (see Figure), which is at the heart of modern Balanced Scorecard (The Advanced Performance Institute (API), n.d.). A Strategy Map are communication tools to show how is created for an organization. Strategy maps show a logical, step-by-step connection between strategic objectives (shown as ovals on the map) in the form of a cause-and-effect chain (Balanced Scorecard Institute, n.d.- a).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*fzNcb2MJLuxnGj-TbUmdIw.png" /><figcaption>Figure 1 Strategy Map (Balanced Scorecard Institute, n.d.- a)</figcaption></figure><p>With respect to the values of the four perspectives in the BSC, the financial perspective ranks higher despite supplementing these with metrics from three additional perspectives (Kaplan R. S., 2010) as “[t]imely and accurate funding data will always be a priority” (Balanced Scorecard Institute, n.d.- a). However, this creates an issue for public and non-profit organisations as the BSC values financial metric data higher in organisation where success cannot be measured in financial terms. Although Kaplan does recognize that the BSC has its short comings when applied to public sector organizations (PSOs) — “The financial perspective provides a clear long-run objective for profit seeking corporations; however, it serves as a constraint, not an objective, for PSOs.” (Kaplan R. S., 1999). He recognizes that the success of PSOs should be measured according to how effectively and efficiently they meet the needs of their constituencies. Hence, the BSC has to be adapted accordingly (see picture below).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/960/1*4Hy5DDaHS8gm0SDc46eXEw.png" /><figcaption>Figure 2 Private vs Public Balanced Scorecard (Strategy Map: Capture a Cause Effect Relationship from the Bottom Up, 2016)</figcaption></figure><p>The use of the BSC in the public sector stresses the role of ‘Mission-Support-Capacity Framework’ (Kaplan R. S., 2006) based on:</p><ul><li>Mission: Social Value Created</li><li>Support: Adequate Resources Provided</li><li>Capacity: Ability to Execute</li></ul><p>As we can see in the graph below capacity encompasses three perspectives: Internal, Learning &amp; Growth and Financial. Note that the Financial Perspective is at the bottom of the value chain.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/692/1*bh_YU6E5cMzXPCK88xeeOw.png" /><figcaption>Figure 3 Capacities and perspectives (Kaplan R. S., Using the Balanced Scorecard in the Public Sector, 2006)</figcaption></figure><p>Despite the claim by Kaplan and Norton that the BSC can be adapted to the public sector by putting the customer at the top of the hierarchy (see right graph in picture), there is evidence from the public sector that the BSC still fails to measure important outcomes (Moullin, 2013). One of the main issues with the BSC is that its language, architecture and methodology is directed towards the private sector (Moullin, 2013). Hence, the most important perspective, as mentioned above, of the BSC is still the financial perspective (see left graph “Private Sector View”). Moullin criticizes that the BSC, arguing that it has a “tendency to prize financial outcomes above all others” (Robinson, 2015), which is not ideal when the measurement of an outcome is not based on the bottom line. The issue is that the BSC has “little emphasis on service user involvement, risk management, or the need to work across organisational boundaries” (Moullin, 2013). According to Moullin (2013), most public and third sector organisations face two typical issues:</p><ol><li>How to improve outcomes for service users and other key stakeholders without increasing overall cost?</li><li>How to develop performance measures that ensure quality without motivating staff to achieve arbitrary targets at the expense of poor service?</li></ol><p>To address the issues mentioned above, Moullin developed the Public Sector Scorecard (PSS) which is an integrated service improvement and performance management framework for public and non-profit organisations. PSS is a workshop-based approach driven by diverse inputs and focused on three fundamental considerations: capabilities, processes and outcomes (Robinson, 2015). The idea is that “capabilities lead to processes and processes lead to outcomes” (Robinson, 2015), see figure. The key features of PSS are:</p><ul><li>Focus on outcomes and evidence-based drivers of outcomes</li><li>Provide a link between strategy, organisational culture and resource issues</li><li>Incorporate service re-design, organisational culture and resource issues</li><li>Ideal for use across organisational boundaries</li><li>Integrated risk management</li><li>Culture of improvement, innovation &amp; learning (not blame culture). (Public Sector Scorecard, n.d.)</li></ul><p>At the core of the PSS is that it focuses on effective performance management through collaboration, inclusion of frontline staff, end users and other stakeholders in establishing metrics that are constructive. Outcomes should be measured according to a variety of interested parties, and also be adjusted accordingly (Robinson, 2015).</p><h3>Usability and impact</h3><p>Whether one uses the balanced scorecard (BSC) or the Public Sector Scorecard (PSS), either offers a comprehensive picture of strategy, taking into account all its components. They offer a balanced view between outcomes and enablers of a strategy. Public sector organisations are increasingly under pressure to ensure that public money is allocated intelligently. They must be able to measure and report whether strategic objectives are being met, and whether stakeholders and customers support these objectives. It is about aligning aims, outcomes, outputs and enablers (or capacity). It is not merely about one step in the process, but the whole process, from start to finish.</p><p>This is very valuable in the development and implementation of a successful smart specialisation strategy. What is the aim of the S3 strategy? Is the aim shared by stakeholders and customers? Is there capacity to achieve the aim? Once the strategy has been laid out, the scorecard offers a tool to continuously monitor and evaluate the process and feed it back into the strategy to make adjustments if necessary, creating a loop for learning. It allows the effects of actions to be traced efficiently and any negative actions to be rectified through the adjustment of goals.</p><h3>Required data</h3><p>The method would require the stakeholder to be able to evaluate the goals that had been set and implemented in the region. It would require stakeholder input in order to analyse the customer perspective, economic data to analyse the financial perspective, data on businesses for the business process perspective, and lastly data on the internal working of businesses or employee input in order to manage the analysis of the learning and growth perspective. Public Sector Scorecard stresses the importance of involving stakeholders in the process — “the benefits of involving stakeholders — not just in judging performance but in devising how performance should be judged in the first place” (Robinson, 2015).</p><h3>Relevant data sources</h3><p>The Balanced Scorecard</p><ul><li>The Balanced Scorecard Institute (BSI): <a href="http://balancedscorecard.org/">http://balancedscorecard.org</a></li><li>The Advanced Performance Institute (API): <a href="http://www.ap-institute.com/strategy-management-articles/the-balanced-scorecard-a-complete-introduction.aspx">http://www.ap-institute.com/strategy-management-articles/the-balanced-scorecard-a-complete-introduction.aspx</a></li><li>Balanced Scorecard 2012 IAS Conference: <a href="http://ec.europa.eu/dgs/internal_audit/pdf/conference_2012/moueddene_pres.pdf">http://ec.europa.eu/dgs/internal_audit/pdf/conference_2012/moueddene_pres.pdf</a></li><li>The Public Sector Scorecard: <a href="http://www.publicsectorscorecard.co.uk/">www.publicsectorscorecard.co.uk</a></li></ul><p>See also references used under this method.</p><h3>Implementation roadmap</h3><p>The key to the successful development of a balanced scorecard process is to link measurements to the strategy. According to Kaplan and Norton (2004), there are three main questions that should be asked during this process (slightly adjusted):</p><ol><li>If the vision and strategy is successfully implemented, what difference will it have in terms of how:</li><li>the customers perceive the organisation</li><li>it affects the internal process of the organisation and</li><li>it affects the ability to learn and grow.</li><li>What are the critical success factors in each of the perspectives in the value chain (perspectives)?</li><li>What are the key measurements that will signal that the organisation is addressing the success factors as planned?</li></ol><p>The Balance Scorecard Institute has developed the <em>Nine Steps to Success</em>TM for building and implementing a Balanced Scorecard (BSC), starting at the top with<em> Assessment</em>. It is a practical approach to developing a strategic planning and management system based on the BSC. Important aspects of the framework are training, coaching, change management, and problem solving. The idea of the framework is to give organizations a way to ‘connect the dots’ between the various components of strategic planning and management, that is, there will be a visible connection between the projects and programs that people are working on, the measurements being used to track success, the strategic objectives the organization is trying to accomplish and the mission, vision and strategy of the organization. (Balanced Scorecard Institute, n.d.- b).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/642/1*aUNs7M-6hnRrT81MGkZzew.png" /><figcaption>Figure 4 <em>Nine Steps to Success</em>TM (Balanced Scorecard Institute, n.d.- b)</figcaption></figure><p>The logic of the integrated strategic planning and management with a BSC is presented with a pyramid (see below).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/959/1*IGjnEkPb7Jg2u2kIK93iHg.png" /><figcaption>Figure 5 How does all of this terminology fit together logically? (Balanced Scorecard Institute, n.d.-c)</figcaption></figure><p><strong>Balances Scorecard (Public view)</strong></p><p>Taking the BSC from a public and non-profit sector perspective, Kaplan (1999) states that the “start of any performance management exercise must be to reaffirm or focus the organization’s strategy: to define what it is uniquely qualified to do and to reject possibilities that will not deliver on the organization’s mission and purpose”. Furthermore, a well-articulated, focused strategy will help evaluation with the BSC.</p><p>The first thing public and non-profit organisations should do is to start by identifying an overarching objective for their mission at the top of their scorecard. Kaplan (1999) mentions that the financial and customer perspective of the BSC can be combined to provide a framework in which a government organisation has three high level themes: Cost Incurred, Value Created, and Legitimizing Support.</p><p>After the top-level scorecard has been created, the next step for public and non-profit organizations, similarly to private-sector organizations, is to deploy the process down through to its individual departments. The departmental scorecards must reflect the themes and objectives established in the top-level scorecard. The local scorecards describe how each department does its job to contribute to the top-level organizational objectives.</p><p><strong>Public Sector Scorecard (PSS)</strong></p><p>The Public Sector Scorecard is a workshop-based approach with three phases: <em>Strategy mapping</em>, <em>Service improvement</em>, and <em>Measurement and Evaluation</em> (see figure).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/497/1*mzsBLEdeZzyG7MImMrbIeQ.png" /><figcaption>Figure 6 The Three Phases of the Public Sector Scorecard (Robinson, 2015)</figcaption></figure><p><strong>Phase one — Strategy mapping</strong>: is the key output of the PSS, showing the relationships between outcomes and process and capability outputs. The phase is centred around a number of interactive workshops attended by a wide range of stakeholders that work together to discuss desired outcomes — strategic, financial, user-centric, etc. and the processes and capabilities needed to achieve them.</p><p><strong>Phase two — Service improvement</strong>: the strategy map is used as a quick way to appraise the effectiveness of different processes in satisfying the desired outcomes. This phase should become more factual by using available evidence or data, supplemented where appropriate by tools such as process maps, systems thinking and lean management.</p><p><strong>Phase three- Measurement and evaluation</strong>: here possible performance measures for each element of the strategy map should be considered, which should be selected on the basis that they provide value, are cost effective and minimise any perverse effects. According to Moullin (Robinson, 2015) “Performance measures don’t have to be strictly quantitative … In many cases — especially in some capability areas — more qualitative approaches are preferable”.</p><p>What is important is that an evaluation strategy should be developed in an early stage project group, task force, etc., as it helps to form the strategies and processes to meet the desired goals.</p><p></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f930b6416945" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/6-3-balanced-scorecard-f930b6416945">6.3. Balanced scorecard</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[6.4. RIS3 beneficiaries and end users’ satisfaction online survey]]></title>
            <link>https://medium.com/onlines3-consultation/6-4-ris3-beneficiaries-and-end-users-satisfaction-online-survey-8965224ff9f8?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/8965224ff9f8</guid>
            <category><![CDATA[monitoring-and-evaluation]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Mon, 19 Dec 2016 19:46:46 GMT</pubDate>
            <atom:updated>2016-12-19T19:46:46.036Z</atom:updated>
            <content:encoded><![CDATA[<h4>The method will enable collecting micro data directly from the beneficiaries and ‘end-users’ of public policies implemented through S3.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/1*aPS4m0f1_YHJkEJyjJyHZA.png" /></figure><p>This method will enable the collection of micro data directly from the beneficiaries and ‘end-users’ of public policies implemented through S3. It is intended to assist in understanding how well-suited measures were to the needs of firms, research institutes, universities, as well as civil society organisations such as NGOs. It allows also for cross-regional analysis of satisfaction and can inform the RIS3 update process. It could also be used for defining baseline values of satisfaction as well as target values. The method requires a well-designed online survey questionnaire. The questionnaire has to be general enough to capture all types of EU regions and policy measures, and specific enough that it is able to quantify overall satisfaction of beneficiaries. Multi-language functionalities and a strong dissemination strategy among end-users is needed.</p><p>One tool that can be used in monitoring and evaluation is the use of online surveys. The mapping exercise identified only four regions that applied online surveys for monitoring and evaluation purposes. In none of the cases was it indicated that surveys were used for measuring beneficiaries and end users’ satisfaction in the public policies implemented through S3. By measuring their satisfaction levels, it is possible to adjust the policies according to the opinions of stakeholders who are most affected by the policies. To encourage regions to conduct these surveys, a ready survey template could be provided for them on the Online S3 platform. The template would save the policymakers a lot of time and also allow for cross-regional analysis of beneficiary satisfaction at the EU level.</p><h3>Description of the method</h3><p><strong>Tool</strong></p><p>The method will consist of online survey templates that are used for measuring satisfaction in RIS3 policies. For this purpose, two types of survey templates could be provided: one for measuring satisfaction in one individual policy, and another one for measuring satisfaction in multiple policies and the whole strategy at once. The templates consist of general well-defined questions that are applicable to all EU regions and policy measures. They could also be translated into all official EU languages.</p><p>The templates could be given in two forms. First, as downloadable templates that can be transferred to any survey platform manually or be distributed physically. Second, as a ready online survey that is automatically generated for the user by an app as part of the survey platform. The first option allows the user to choose any survey platform and to easily modify the templates. However, the second option saves time for the user since they only need to distribute the link to the survey. To help with the distribution, instructions could be given, for example, regarding the right channels, stakeholders, etc.</p><p><strong>Use</strong></p><p>The surveys would be used for the constant development and adjustment of public policies. The idea is it that when regions implement or plan public policies based on their smart specialisation strategies, they simultaneously distribute surveys to stakeholders in order to receive feedback on them. The feedback from the surveys is then used to adjust the policies. Additionally, the surveys are distributed periodically to ensure constant development of the policies. This also allows regions to follow the development of stakeholder satisfaction regarding policies over time.</p><h3>Usability and impact</h3><p>The surveys are an effective way to improve stakeholder participation in RIS3 strategies. They are easy to create and distribute, and they allow regions to receive direct feedback from the stakeholders on policies, an area that has been somewhat neglected previously. By creating a ready survey template, regions will likely use surveys since the regional policymakers do not have to spend their own time on creating them. Additionally, by providing a common template it is possible to compare the results between regions and to use the data, for example, for academic and development purposes.</p><h3>Required data</h3><p>This method requires well-though-out survey templates for measuring satisfaction in RIS3 policies. The questions should be applicable to every EU region and to a wide range of possible policies. Also, the survey should assume that the participant does not know what RIS3 means and what the implemented RIS3 policies are. Therefore, a clear but concise description of the strategy and the individual policies should be given.</p><p>In addition to background information, the questions of the survey could cover multiple aspects such as:</p><ul><li>Communication (i.e. Did the participant know about the policy or strategy?)</li><li>Effect (i.e. How is the participant affected by the policy?)</li><li>Satisfaction (i.e. Does the policy or strategy please the participant?)</li><li>Improvement (i.e. How would the participant like to improve the policy or strategy?)</li><li>etc.</li></ul><p>Most of these aspects could be measured, for example, using a Likert scale and open-ended questions. Overall, the survey should give a sufficient view of the end users’ opinion regarding the region’s RIS3 and its policies.</p><h3>Relevant data sources</h3><p>Relevant data sources:</p><ul><li>Already applied surveys in RIS3 context, for example, by regions or studies</li></ul><p>Survey platforms:</p><ul><li>Google (with API)</li><li>Webropol, SurveyMonkey, ZEF, etc.</li></ul><h3>Implementation roadmap</h3><p>To measure satisfaction in implemented policies:</p><ol><li>Download a suitable template</li><li>Study it and modify it to suit the respective policy/policies</li><li>Host it on a survey platform</li><li>Advertise the survey to stakeholders</li><li>Analyse the results carefully</li><li>Adjust the results based on the results</li><li>Repeat periodically to maintain a constant development</li></ol><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8965224ff9f8" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/6-4-ris3-beneficiaries-and-end-users-satisfaction-online-survey-8965224ff9f8">6.4. RIS3 beneficiaries and end users’ satisfaction online survey</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[6.5. RIS3 social media analysis]]></title>
            <link>https://medium.com/onlines3-consultation/6-5-ris3-social-media-analysis-67dae84ad17a?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/67dae84ad17a</guid>
            <category><![CDATA[monitoring-and-evaluation]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Mon, 19 Dec 2016 19:31:47 GMT</pubDate>
            <atom:updated>2016-12-19T20:51:42.232Z</atom:updated>
            <content:encoded><![CDATA[<h4>This online tool offers simple indicators on the overall RIS3 process by using data coming from social media, such as Twitter or Google trends.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/1*_IT_-cVQu1Erm0TavIJibQ.png" /></figure><p>This online tool offers simple indicators on the RIS3 process by using data coming from social media sites, such as Twitter or Google trends with regards the overall process, or also allow for specific searches with keywords of key policies or programmes implemented in the region. Using natural language ontologies, it could allow for cross-regional comparisons or S3 social ‘interest’. However, the mapping exercise did not identify any pre-existing method that is relevant to describe social media analysis in RIS3.</p><p>As reported by Charalabidis et al. (2012b), <em>“a considerable body of knowledge on how social media can be used effectively by enterprises for supporting and strengthening various functions, such as marketing, customer relationships, new product development, etc.”</em>. Unfortunately, <em>“in contrast, the benefits of social media and the application of social media analytics for governmental organizations has not been observed comparably”</em> (Gotsch and Grubmuller, 2013)</p><p>Current research on the use of social media analytics in public sector reveals indeed that <em>“governments are just about to explore the opportunities that [are offered by] social media and the analysis of user-generated contents”</em> (Grubmüller et al., 2013). This is particularly evident in the field of RIS3, in which the application of social media analytics has the potential to track and capture satisfaction of beneficiaries with the RIS3 process overall and increase collaboration. Indeed, according to the Joint Research Centre’s Institute for Prospective Technological Studies (Osimo, 2008; Pascu, 2008; Pascu et al. 2007; 2008), ICT-enabled solutions for the application of social media analytics can effectively support and facilitate the development and implementation process of Smart Specialisation Strategies.</p><p>However, the lack of case studies and literature dealing with the use of this method in the context of Smart Specialisation Strategies makes it difficult to explore its practical implications.</p><h3>Description of the method</h3><p>Despite this situation, however, useful insights into how to use social media analytics in the development of Smart Specialisation Strategies can be acquired by looking at the several research projects implemented over the years in the public sector thanks to the European Commission’s financial support. In the last decade, the European Commission has indeed expressed a strong interest in this subject and funded several projects aimed at building ICT-based SMA (social media analytic) tools for gathering feedback, detecting future trends, stimulating collaboration and supporting evidence-based decision and policy making. Some interesting examples are:</p><ul><li>NOMAD (Policy Formulation and Validation through non-moderated crowdsourcing)</li><li>PADGETS (Policy Gadgets Mashing Underlying Group Knowledge in Web 2.0 Media)</li><li>ImmigrationPolicy2.0 (Participatory Immigration Policy Making and Harmonization based on Collaborative Web2.0 Technologies)</li><li>Puzzled by Policy</li><li>UniteEurope (Social Media Analytics and Decision Support Tools Enabling Sustainable Integration Policies and Measures)</li></ul><p>The tools developed by these projects are considered of great value to the ONLINE-S3 project because they highlight the potentials offered by the analysis of contents extracted by social media. Moreover, they provide useful knowledge and lessons on how to develop the ICT-driven services, tools and applications for RIS3 social media analytics which are going to populate the ONLINE Platform for Smart Specialisation Policy Advice.</p><p><strong>NOMAD (Policy Formulation and Validation through non-moderated crowdsourcing)</strong></p><p>The project has produced a fully automated ICT-based SMA platform which allow decision-makers to analyse the vast amount of user-generated contents and opinions sourced from social media and blogs and use this data for supporting the development of public policies and strategies (<a href="http://cordis.europa.eu/project/rcn/102148_en.html)">http://cordis.europa.eu/project/rcn/102148_en.html)</a>. The architecture of the platform is shown in Figure 1 and its main components are the following: 1) Policy Modeling Tool; 2) Data Acquisition Module; 3) Linguistic Processing Pipeline; 4) Opinion Mining &amp; Argument Extraction; 5) Argument Summarization; 6) Social Reaction Visualization (Charalabidis et al., 2012b).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*_1pEtWCX-mSTGRN0-6J4Og.png" /><figcaption>Figure 1 NOMAD platform’s technological architecture ( Source: Charalabidis et al. (2012b))</figcaption></figure><p><strong>PADGETS (Policy Gadgets Mashing Underlying Group Knowledge in Web 2.0 Media)</strong></p><p>PADGETS has developed a prototype service for policy makers that uses social media technologies and techniques to: boost public engagement; enable cross-platform publishing and content tracking; and provide support to decision making. With the PADGETS platform, messages related to public policies can be disseminated simultaneously within multiple social media sites, but using a single integrated interface. This makes it possible to reach large user groups. Their feedback is then collected by the platform, that keeps track of and analyses the users’ reaction by each message (Ferro et al., 2010). This system can therefore empower “<em>citizens to better participate in decision making processes and public deliberation of policies by increasing the impact of their opinions [and feedbacks] while dramatically reducing the effort and cost of projecting them in the public sphere”</em> (<a href="http://www.padgets.eu)/">http://www.padgets.eu)</a>.</p><p><strong>ImmigrationPolicy2.0 (Participatory Immigration Policy Making and Harmonization based on Collaborative Web2.0 Technologies)</strong></p><p>ImmigrationPolicy2.0 has developed and piloted <em>“a range of citizen-centric services which facilitate the participation of citizens in the migration policy development process. […] The services support [the] drafting [of] immigration policy text, develop and test policy models, evaluate scenarios (“what-if” process), as well as harmonizing policy text</em>”. Moreover, they facilitate <em>“societal group of immigrants with migration background […] to get informed” </em>and can be used to <em>“evaluate various migration-related proposals and policies […]. The process [involved] the development of new models for citizens’ legal residents’ participation, as well as the collection and analysis of collaborative input from multiple citizens. The pilot services of the project [was] offered over a centralized, collaborative, trustful migration platform (conveniently called ImmigrationPolicy2.0 platform) enabling users (i.e. policy makers, politicians, decision makers, citizens) to identify, model, visualise, analyse and evaluate national migration policies, practices, monitor and accordingly harmonise easily their procedures and data formats relateding to their economic activities and documents involved (e.g. civil status documents i.e. (e.g. residence permits/certificates, work permits, civil status certificates, family unification certificates)” </em>(<a href="http://cordis.europa.eu/project/rcn/191809_en.html">http://cordis.europa.eu/project/rcn/191809_en.html</a>).</p><p><strong>Puzzled by Policy</strong></p><p>Puzzled by Policy aimed <em>“to address the specific issue of immigration in a manner that likewise addresses the broader issue of widespread confusion about and disengagement from the policymaking process by providing all citizens [with] an informative and easy-to-use platform to engage topical policy issues”. </em>To achieve this aim, the project’s team has developed, <em>“tried and tested eParticipation […] tools such as EU Profiler and Debategraph with new widget applications to reduce the complexity of decision making at the EU level and ‘push’ the platform to popular social media sites such as Facebook and Twitter as well as to their own desk top and mobile devices”</em> (<a href="http://www.puzzledbypolicy.eu/">http://www.puzzledbypolicy.eu</a>).</p><p><strong>UniteEurope</strong></p><p>UniteEurope has developed a software that analyses social media contents related to migrant integration at the city level. <em>“Through a sophisticated and automatized filtering of public social media contents, [this] tool [can] analyse migrant integration specific posts produced by citizens, communities, and organizations”</em>. The software helps policy makers to <em>“judge on current discussions on migrant integration issues; to proactively or reactively take actions; and to monitor effects on actions taken” </em>(UniteEurope Consortium, 2014a). The UniteEurope tool supports sources of three different stream types: Twitter, Facebook and Google+ (UniteEurope Consortium, 2014b).</p><h3>Usability and impact</h3><p>Considering the usability and impact of social media analytics in the public sector, which are shown by the above-mentioned projects, the use of this method in relation to the design and implementation of Smart Specialisation Strategies can provides the governance system with the possibility to integrate valuable stakeholders’ insights, opinions and feedback, detect future trends, stimulate collaboration and support evidence-based decision making processes by taking public opinion into account. This method can also help increase transparency (United Nations — Department of Economic and Social Affairs, 2012; European Commission 2016). What is more, the World Bank (2012) reports that social media platforms generate higher public participation rates than other conventional e-government applications. These tools can play an even greater role in strengthening and widening the participation of and interaction with citizens (Charalabidis et al. 2012a; 2012b). Moreover, in the RIS3 context, social media analytics can help articulate the collaborative visioning process and better legitimate the selection of specific scenarios emerging during the strategy formulation.</p><h3>Required data</h3><p>Considering the projects previously described, RIS3 social media analytics require user-generated contents like posts, feedbacks, comments, etc. These contents can be gathered from: 1) the social media services belonging to the public authority which is developing its Smart Specialisation Strategy; 2) existing social media (See Table 1 in the next section), such as Twitter, Facebook, Google, YouTube and Wikipedia (Bakhshi and Mateos-Garcia 2016; Brainard and Edlins 2014; Yang and Rim, 2014; Gerber, 2014; Dehkharghani et al., 2014; Collins et al., 2013; Dehghani and Tumer, 2015; Askitas 2015). Data for RIS3 social media analytics can also be extracted from online newspapers, blogs, online communities, etc. (Gotsch and Grubmuller, 2013)</p><p>Moreover, even if this aspect does not significantly emerge from the projects previously discussed, when talking about using user-generated contents extracted from social media in the public sector and in the RIS3 development process, one major implication is privacy. This generates some fundamental concerns for public authorities <em>“seeking to develop their own social media [groups] or strategies for engaging with other sites […]. Users willingly share their identities on social media sites such as Facebook and Twitter, yet this does not mean they do not care what happens to this information. Indeed, users have serious concerns about how secondary firms use their information as a source for data mining and surveillance […], and the extent to which social media sites passively facilitate or actively encourage these activities”</em> (Kietzmann et al., 2011). This may result in legal actions for invasion of privacy (Kravets, 2010).</p><h3>Relevant data sources</h3><p>The European project NOMAD (Policy Formulation and Validation through non-moderated crowdsourcing) offers a list of the 50 most used social media from which the user-generated contents can be collected (Xenakis et al., 2012). The list is reported in Table 1. Considering that no case studies can be identified in which social media analytics has been used in the field of RIS3, this table represents a list of potential data sources to be considered and tested.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/820/1*tXRE53O_4KW1FgfeEAlHpQ.png" /><figcaption>Table 1 List of the 50 most used social media (Source: Xenakis et al. (2012))</figcaption></figure><h3>Implementation roadmap</h3><p>A possible implementation roadmap for social media analytics in the development of RIS3 is presented in Figure 2. This roadmap is based on the analysis of the previous projects and research by Fan and Gordon (2014). ICT-enabled solutions for social media analytics can facilitate the development and implementation of this roadmap.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*hcmJetCohSK-AIvP1p_3Hg.png" /><figcaption>Figure 2 Social media analytics process ( Source: Fan and Gordon (2014))</figcaption></figure><p><strong>Phase 1. Capture</strong></p><p>Relevant social media data are obtained by monitoring or listening to various social-media sources. This stage<em> “helps identify conversations on social media platforms related to” </em>the<em> </em>RIS3 process and can<em> </em>cover<em> “popular platforms (such as Facebook, Foursquare, Google+, LinkedIn, Pinterest, Twitter, Tumblr, and YouTube), as well as smaller, more specialized sources (such as Internet forums, blogs, microblogs, wikis, news sites, picture-sharing sites, podcasts, and social-bookmarking sites)”. </em>Data collected from the selected sources is used to prepare a dataset which is going to be used in Phase 2<em>. “Various preprocessing steps may be performed, including data modeling, data and record linking from different sources, stemming, part-of-speech tagging, feature extraction, and other syntactic and semantic operations that support analysis”</em> (Fan and Gordon, 2014).</p><p><strong>Phase 2. Understand</strong></p><p>After collecting the conversations related to the RIS3 process, their meaning needs to be assessed and the metrics for decision making needs to be developed.<em> “Since the capture stage gathers data from many users and sources, a sizeable portion may be noisy and thus has to be removed prior to meaningful analysis. Simple, rule-based text classifiers or more sophisticated classifiers trained on labeled data may be used for this cleaning function. Assessing meaning from the cleaned data can involve statistical methods and other techniques derived from text and data mining, natural language processing, machine translation, and network analysis. The understand stage provides information about user sentiment and their behavior […]. Many useful metrics and trends about users can be produced in this stage, covering their backgrounds, interests, concerns, and networks of relationships”</em> (Fan and Gordon, 2014).</p><p><strong>Phase 3. Present</strong></p><p><em>“The results from different analytics are summarized, evaluated, and shown to users in an easy-to-understand format. Visualization techniques may be used to present useful information; one commonly used interface design is the visual dashboard, which aggregates and displays information from multiple sources. Sophisticated visual analytics go beyond the simple display of information. By supporting customized views for different users, they help make sense of large amounts of information, including patterns that are more apparent to people than to machines. Data analysts and statisticians may add extra support”</em> (Fan and Gordon, 2014).</p><h3>References</h3><ul><li>Askitas, N. (2015). Google Search Activity Data and Breaking Trends. Institute for the Study of Labor (IZA). <a href="https://ideas.repec.org/a/iza/izawol/journly2015n206.html.">https://ideas.repec.org/a/iza/izawol/journly2015n206.html.</a> Accessed 18.11.2016.</li><li>Bakhshi, H., &amp; Mateos-Garcia, J. (2016). New Data for Innovation Policy. Nesta. <a href="https://www.oecd.org/sti/106%20-%20Bakhshi%20and%20Mateos-Garcia%202016%20-%20New%20Data%20for%20Innovation%20Policy.pdf.">https://www.oecd.org/sti/106%20-%20Bakhshi%20and%20Mateos-Garcia%202016%20-%20New%20Data%20for%20Innovation%20Policy.pdf.</a> Accessed 18.11.2016.</li><li>Brainard, L., &amp; Edlins, M. (2014). Top 10 U.S. Municipal Police Departments and Their Social Media Usage. <em>American Review of Public Administration,</em> 45(6), 728–745.</li><li>Charalabidis, Y., Loukis, E., &amp; Kleinfeld, R. (2012a). Towards a Rationalisation of Social Media Exploitation in Government Policy-Making Processes. <em>European Journal of ePractice,</em> 16, 77–93.</li><li>Charalabidis, Y., Triantafillou, A., Karkaletsis, V., &amp; Loukis, E. (2012b). Public Policy Formulation Through Non Moderated Crowdsourcing in Social Media. In E. Tambouris, A. Macintosh, &amp; Ø. Sæbø (Eds.), <em>Electronic Participation: 4th IFIP WG 8.5 International Conference, EPart 2012, Kristiansand, Norway, September 3–5, 2012. Proceedings </em>(pp. 156–169). New York: Springer.</li><li>Collins, C., Hasan, S., &amp; Ukkusuri, S. V. (2013). A Novel Transit Rider Satisfaction Metric: Rider Sentiments Measured From Online Social Media Data. <em>Journal of Public Transportation,</em> 16(2), 21–45.</li><li>Dehghani, M., &amp; Tumer, M. (2015). A Research on Effectiveness of Facebook Advertising on Enhancing Purchase Intention of Consumers. <em>Computers in Human Behavior,</em> 49, 597–600.</li><li>Dehkharghani, R., Mercan, H., Javeed, A., &amp; Saygin, Y. (2014). Sentimental Causal Rule Discovery From Twitter. <em>Expert Systems with Applications,</em> 41(10), 4950–4958.</li><li>Fan, W., &amp; Gordon, M. D. (2014). The Power of Social Media Analytics. <em>Communications of the ACM,</em> 57(6), 74–81.</li><li>Ferro, E., Boero, R., Iosif, A., Gionis, G., Triantafyllou, A., Kallipolitis, L., Diamantopoulou, V., Charalabidis, Y., Maragoudakis, M., &amp; Loukis, E. (2010). PADGETS: D2.1: Padget Design and Decision Model for Policy Making. Research Report of the PADGETS Project (European Union’s Seventh Framework Programme). <a href="http://cordis.europa.eu/docs/projects/cnect/0/248920/080/deliverables/001-PADGETSD21DesignDecisionModelV1.pdf.">http://cordis.europa.eu/docs/projects/cnect/0/248920/080/deliverables/001-PADGETSD21DesignDecisionModelV1.pdf.</a> Accessed 18.11.2016.</li><li>Gerber, M. S. (2014). Predicting Crime Using Twitter and Kernel Density Estimation. <em>Decision Support Systems,</em> 61, 115–125.</li><li>Götsch, K., &amp; Grubmüller, V. (2013). Web 2.0 for Local Policy and Decision Making Support Research &amp; Development: Results From the ICT Project UniteEurope . In M. A. Wimmer, M. Janssen, A. Macintosh, H. Jochen Scholl, &amp; E. Tambouris (Eds.), <em>Electronic Government and Electronic Participation: Joint Proceedings of Ongoing Research of IFIP EGOV and IFIP EPart 2013, Koblenz, 16–19 September 2013 </em>(pp. 116–123). Bonn: Gesellschaft für Informatik.</li><li>Grubmüller, V., Götsch, K., &amp; Krieger, B. (2013). Social Media Analytics for Future Oriented Policy Making. <em>European Journal of Futures Research,</em> 1(20).</li><li>Kietzmann, J. H., Hermkens, K., McCarthy, I. P., &amp; Silvestre, B. S. (2011). Social Media? Get Serious! Understanding the Functional Building Blocks of Social Media. <em>Business Horizons,</em> 54(3), 241–251.</li><li>Kravets, D. (2010). Judge Approves $9.5 Million Facebook ‘Beacon’ Accord. Wired. <a href="https://www.wired.com/2010/03/facebook-beacon-2/">https://www.wired.com/2010/03/facebook-beacon-2/.</a> Accessed 12.12.2016.</li><li>Osimo, D. (2008). <em>Web 2.0 in Government: Why and How?. </em>Luxembourg: Office for Official Publications of the European Communities.</li><li>Pascu, C. (2008). <em>An Empirical Analysis of the Creation, Use and Adoption of Social Computing Applications. </em>Luxembourg: Office for Official Publications of the European Communities.</li><li>Pascu, C., Osimo, D., Turlea, G., Ulbrich, M., Punie, Y., &amp; Burgelman, J. (2007). Social Computing: Implications for the EU Innovation Landscape. <em>Foresight,</em> 10(1), 37–52.</li><li>Pascu, C., Osimo, D., Ulbrich, M., Turlea, G., &amp; Burgelman, J. (2007). The Potential Disruptive Impact of Internet 2 Based Technologies. <em>First Monday,</em> 12(3).</li><li>United Nations — Department of Economic and Social Affairs (2012). <em>E-Government Survey 2012: E-Government for the People. </em>New York City, NY: United Nations.</li><li>UniteEurope Consortium (2014a). Supporting Local Integration Policies Through Scientific and Ethical Social Media Analytics: A Decision Support Tool for Evidence- Based and Sustainable Policies and Measures. Policy Brief of the UniteEurope Project (European Union’s Seventh Framework Programme). <a href="http://www.zara.or.at/_wp/wp-content/uploads/2014/09/UniteEurope_D7.8_Policy-brief.pdf.">http://www.zara.or.at/_wp/wp-content/uploads/2014/09/UniteEurope_D7.8_Policy-brief.pdf.</a> Accessed 18.11.2016.</li><li>UniteEurope Consortium (2014b). D5.10 — WP5: Application Development and Functionality. Report 2. Report of the UniteEurope Project (European Union’s Seventh Framework Programme). <a href="http://www.uniteeurope.org/images/deliverables/uniteeurope_d5.10_website.pdf.">http://www.uniteeurope.org/images/deliverables/uniteeurope_d5.10_website.pdf.</a> Accessed 12.12.2016.</li><li>World Bank (2012). <em>Information and Communications for Development 2012: Maximizing Mobile. </em>Washington, DC: World Bank.</li><li>Xenakis, A., Spiliotopoulou, L., Androutsopoulou, A., Koutras, C., Charalabidis, Y., Loukis, E., Christopoulos, G., Karkaletsis, V., Krithara, A., Scaltsas, D., Koryzis, D., &amp; Triantafillou, A. (2012). NOMAD: D2.1 Classification of Web 2.0 Social Media and Stakeholder Characteristics. Research Report of the NOMAD Project (European Union’s Seventh Framework Programme). <a href="http://www.nomad-project.eu/Portals/0/d2.1_v1.0.pdf.">http://www.nomad-project.eu/Portals/0/d2.1_v1.0.pdf.</a> Accessed 18.11.2016.</li><li>Yang, M., &amp; Rim, H. (2014). Identifying Interesting Twitter Contents Using Topical Analysis. <em>Expert Systems with Applications,</em> 41(9), 4330–4336.</li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=67dae84ad17a" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/6-5-ris3-social-media-analysis-67dae84ad17a">6.5. RIS3 social media analysis</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[5.1. RIS3 intervention logic]]></title>
            <link>https://medium.com/onlines3-consultation/5-1-ris3-intervention-logic-b416cc02768?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/b416cc02768</guid>
            <category><![CDATA[policy-mix]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Mon, 19 Dec 2016 19:08:37 GMT</pubDate>
            <atom:updated>2016-12-19T19:08:36.762Z</atom:updated>
            <content:encoded><![CDATA[<h4>The method allows identifying if different policy measures are coherent with the vision and objectives of the region.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/1*UW-WWKSm_cy8rzYUh8IARA.png" /></figure><p>Intervention logic is a representation of clear and well-thought-out understanding how planned policy actions are expected to lead to desired outcomes. By identifying causal links among inputs, activities, outputs, and longer-term outcomes of a specific policy intervention, it allows to develop a more comprehensive theory of change. Essentially, the intervention logic clarifies how a change induced by policy action at the micro-level (e.g. firms, households) leads to a desired change at a higher-level (e.g. specific sectors, whole economy), and eventually how this change contributes to the achievement of strategic goals at regional or national level.</p><p>Smart specialisation represents a complex policy intervention with the aim to foster regional/national economic transformation. Hence it is important for the regions to carefully design their RIS3 intervention logic linking objectives, targets, inputs, actions, outputs, results and longer-term outcomes. The building of this logical model is particularly important to define further a tailored RIS3 monitoring and evaluation (M&amp;E) framework, which has been set as an ex-ante conditionality for receiving ESIF support. “Explicitly identifying expected changes is equivalent to setting specific objectives for the RIS3 and is hence a fundamental element of the monitoring system” (Kleibrink et.al., 2016). There is an inherent correlation between an intervention logic and the design of M&amp;E framework. On one hand, intervention logic forms a skeleton for M&amp;E system; on the other hand, findings from continuous monitoring and evaluation exercises feed back intelligence that may alter the initial assumptions about certain causal links and thus call for adjustments in the defined theory of change of RIS3.</p><p>Regarding the current approaches to RIS3 intervention logic design, it appears that there are important gaps in the existing practices to devise sound theory of change for smart specialistion. The mapping exercise results show that intervention logic charting exercises during a policy mix design phase have been highlighted only by around 40% of the selected regions. Given that intervention logic should form the backbone for setting the overarching goals of smart specialisation, this seems to be a surprisingly small share. Either regions are not well acquainted with the approaches to intervention logic design or they do not explicitly document their assumptions about causal chains of RIS3 policy intervention.</p><p>A recent study (Kleibrink et.al., 2016) has looked at the issue how regional and national policy-makers in charge of RIS3 perceive the constituent elements and functions of monitoring. In the scope of this study a comprehensive survey among policy makers has been carried out, including also issues about intervention logic set-up. The study team obtained 96 complete responses, 80 from regional policy-makers representing 68 regions, and 16 from national policy-makers representing 12 countries in Europe, corresponding to a total response rate of 22%. The survey results indicated that there is a diverging pattern among regional and national policy-makers in describing the RIS3 intervention logic. “At the regional level, the majority of respondents (64%) report a direct link between the expected changes identified in the strategy and each of the RIS3 priorities. This result is consistent with an intervention logic that is highly priority specific, which accords with the smart specialisation approach. At the national level, respondents related expected changes only to overall RIS3 objectives, showing that national RIS3 are mostly not priority specific” (Kleibrink et.al., 2016).</p><p>Moreover, the study results showed that “only 26% of regional and 19% of national respondents made an explicit connection between result and output indicators, despite evidence of their understanding and application of the RIS3 logic of intervention” (Kleibrink et.al., 2016). The authors point that, if this indication is confirmed, it means that there is an incomplete understanding or misinterpretation of the policy logic of intervention among regional and national policy makers that goes beyond the context of smart specialisation. The weak monitoring of the last phase of policy cycle means that there is no robust ‘implementation theory’ yet in place (Weiss, 1998).</p><h3>Description of the method</h3><p>Designing intervention logic starts with understanding both the problem to be addressed and the desired outcomes to be achieved, specifying the program logic, and building stakeholder consensus related to this theory of change. Once this agreement is in place, stakeholders can focus on selecting appropriate indicators to measure intended outputs and outcomes, setting baseline and target values, and exploring the relevance of available data and data collection methods.</p><p>In order to communicate the logic of intervention, the visual representation of the intervention can take various forms. The design should help practitioners understand not only the intended outcomes of an intervention but also the inputs and activities needed to achieve them. An intervention logic can be designed as a series of boxes (inputs-&gt;processes-&gt;outputs-&gt;outcomes-&gt;impacts), a table, a flowchart, or even a circular sequence.</p><p>Gianelle and Kleibrink (2015) have made the first effort to conceptualise the RIS3 logic of intervention by identifying the key building blocks and setting out their causal logical linkages (see Figure 1). They highlight three phases that constitute the minimum necessary steps of any strategic approach:</p><ol><li>Detection of needs and challenges, i.e. identification of problems — Phase 1</li><li>Decision on the desired transformations, i.e. selection of the most urgent needs and their reframing in terms of strategic objectives — Phase 2</li><li>Definition of the responses to put in place in order to meet the objectives, i.e. formulation of solutions to selected problems — Phase 3.</li></ol><p>Further the authors elaborate that “the responses to meet strategic objectives consist of specific combinations of four elements: (E.1) levers to change the existing state of affairs in specific socio-economic dimensions; (E.2) economic or knowledge domains, specific markets; (E.3) groups or categories of subjects that can potentially activate the change; (E.4) economic or regulatory instruments of intervention” (Gianelle and Kleibrink, 2015). Figure 2 provides a practical example of this conceptualisation of an intervention logic by applying it to agro-food sector.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/563/1*2GNDWWfIlE3VBrXd72aR-g.png" /><figcaption>Figure 1 The logic of intervention in innovation strategies for smart specialisation (Source: Gianelle, C. and Kleibrink, A. (2015))</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/550/1*WRtdPJ3wO1gST1SxgiXwzg.png" /><figcaption>Figure 2 An illustration of the logic of intervention in agro-food ( Source: Gianelle, C. and Kleibrink, A. (2015))</figcaption></figure><p>To facilitate the process in defining causal links and ensuring that policy measures are coherent with the vision and objectives of the region/country, an information support tool will be developed. This tool will categorise all possible types of policy measures relevant to RIS3 implementation, specifying respective beneficiary target groups and possible effects (outputs, results and longer term outcomes).</p><p>A dashboard type of functionality will enable regional and national policy makers to steer the design of an intervention logic for each specific priority. It will allow to select priority domains/markets and, using an online guidance with key questions and issues to be considered, help define specific lever(s) in these priority domains. Further, taking into account the information on the enlisted effects of all types of support measures, users will be able to add policy instruments tailoring a specific policy mix to influence the identified lever(s). The intervention logic design dashboard should be easily extracted as PDF and Word files enabling communication of the rationale behind RIS3 policy intervention among all involved stakeholders. The tool should form an integral part of approaches developed under 6.1 RIS3 monitoring and 6.2 Definition of RIS3 output and result indicators.</p><h3>Usability and impact</h3><p>Charting of RIS3 intervention logic should form the backbone of policy approaches for steering smart specialisation, yet as the available evidence indicates there is still an incomplete understanding or misinterpretation of the policy logic of RIS3 intervention. The application of the intervention logic information tool should help to elucidate to regional and national policy makers possible logical linkages among the identified priority sectors, key levers, main actor target groups and eventually the specific policy instruments. This support will help to make RIS3 policy assumptions more explicit. Clearer and more detailed intervention logic models will help RIS3 managers to ‘plan with the end in mind’, rather than just limiting their focus on inputs, implementation activities and immediate outputs.</p><p>Using the logic model policy makers can also more easily back cast the intended results and longer-term outcomes of a particular support programme (e.g. during a mid-term evaluation) and identify the necessary corrective actions to achieve all desired results. In other words, intervention logic together with a feedback loop from M&amp;E system serves as a living management tool fostering consensus on planned activities, guiding corrective actions, facilitating the coordination of development efforts, charting the course for achieving strategic objectives, and ultimately serving as key accountability instrument to RIS3 stakeholders and wider society.</p><h3>Required data</h3><p>To build the envisioned information tool and dashboard for RIS3 intervention logic design, there is a need to have a list of all priority sectors/domains selected by European regions. The current Smart Specialisation Platform tool — Eye@RIS3 — that maps the selected RIS3 priorities still categorises them according to traditional industry classifications. There is a need to explore, if more fine-tuned classification that includes also cross-sectoral and emerging industries can be devised.</p><p>The tool requires a listing of all relevant policy measures used to support research, development, innovation, entrepreneurship, higher education and skills development. Moreover, there is a need to compile concise and coherent information on evidence of possible outputs, results and longer-term outcomes of each type of support measures. The effects of specific policy intervention obviously differ across various contexts and are influenced by a diverse set of framework conditions, yet results of decades long evaluation exercises across the world can give sound indications on the type of effects that generally can be expected from various policy support measures.</p><h3>Relevant data sources</h3><p>The list of new cross-sectoral and emerging industries should be aligned with the <strong>European Cluster Observatory</strong> categorisation and other policy monitoring tools of DG Growth.</p><p><strong>Science and Innovation Policy Evaluation Repository (SIPER)</strong> is a database consisting of science and innovation policy evaluations from across the world. SIPER is run by a team based at the Manchester Institute of Innovation Research and it gathers a comprehensive repository of evidence on effects of wide range of RDI policy support measures — <a href="http://datasets.risis.eu/metadata/siper">http://datasets.risis.eu/metadata/siper</a>. Various guidance documents, e.g. those commissioned by DG Regio <a href="http://ec.europa.eu/regional_policy/en/policy/evaluations/guidance/#4">http://ec.europa.eu/regional_policy/en/policy/evaluations/guidance/#4</a>, can be used to construct necessary information for policy mix design.</p><h3>Implementation roadmap</h3><ol><li>Develop an elaborated list of RIS3 priority areas/domains</li><li>Develop a guiding questionnaire for helping users to define specific levers within RIS3 priority areas/domains</li><li>Develop a full list of most frequently used policy support measures in support of research, development, innovation, entrepreneurship, higher education and skills development</li><li>Gather and categorise evidence base on possible effects of each support measure type.</li></ol><h3>References</h3><ul><li>Gianelle, C. and Kleibrink, A. (2015). Monitoring mechanisms for smart specialisation strategies, S3 policy brief series, 13/2015. Spain: European Commission, Joint Research Centre.</li><li>Kleibrink, A., Gianelle, C. and Doussineau0, M. (2016) Monitoring innovation and territorial development in Europe: emergent strategic management, European Planning Studies, 24:8, 1438–1458.</li><li>Weiss, C. H. (1998). Evaluation: Methods for studying programs and policies. Englewood Cliffs, NJ: Prentice Hall.</li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b416cc02768" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/5-1-ris3-intervention-logic-b416cc02768">5.1. RIS3 intervention logic</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[5.2. RIS3 action plan co-design]]></title>
            <link>https://medium.com/onlines3-consultation/5-2-ris3-action-plan-co-design-8891944cd030?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/8891944cd030</guid>
            <category><![CDATA[policy-mix]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Mon, 19 Dec 2016 19:00:21 GMT</pubDate>
            <atom:updated>2016-12-19T19:00:20.691Z</atom:updated>
            <content:encoded><![CDATA[<h4>Co-design is a well-established approach in the process of creation, particularly within the public sector.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/374/1*6Zl8QNp7ZvZEuxzqRM9ZfQ.png" /></figure><p>Broadly speaking, co-design is a method for the creative practice, and is also known as participatory co-creation and open design process. Moreover, the method goes <strong>beyond consultation by creating and deepening collaboration</strong> among citizens attempting to resolve a challenge. It is crucial that the users are <strong>willing to share their experience within the design process</strong>. The e-democracy concept — a web-based concept for co-creation, intended ot support democratic decision making, has been discussed more and more over the last ten years for various reasons (Macintosh, 2004). Many citizens are questioning traditional forms of democracy and thus want the policy-making processes to be more innovative and “co-design-driven”. Moreover, the demand for being more intensively involved appears to be on the rise. Additionally, it is vital to encourage democratic societies to share different views and opinions of active citizenship by direct involvement and engagement via co-designing (Tuzzi et al., 2007). E-participation is beneficial to e-government since it is linked to the relationship between govenrment and citizen. (Lironi, 2016).</p><p>In line with the latest report of The World Bank (2016) this co-design / crowdsourcing method can be used to collect and merge data within RIS’s entrepreneurial discovery process to focus on the policy mix. The method’s primary concept facilitates the idea behind crowdsourcing and is intended to be quick, efficient and simple. As recommended by The World Bank (2016) the method encourages a culture of a public–private dialogue, expands public administration’s online presence, including in social media, and facilitates the collaboration among stakeholders.</p><h3>Description of the method</h3><p>The method co-design boosts the involvement of different individuals to deliver a final outcome. Therefore, the method begins with an underlying concept for which the users co-operate:</p><ul><li>a definition of what the system does,</li><li>a development process, and</li><li>a definition of the expected outcome (Sherriff, 2015).</li></ul><p>Furthermore, the users should be committed to the co-production process, since the users have different roles at different stages of the design process (Sherriff, 2015).</p><p><strong>Key issues for the method co-design</strong> (Sherriff, 2015):</p><ul><li><em>Participation</em>: co-design represents a collaboration.</li><li><em>Development</em>: co-design is a process of development for exchanging information and know-how continuously.</li><li><em>Ownership and power</em>: co-design moves power towards the process. The generation of a framework, which describes the required balance of rights and freedoms among users, is required. This will help to establish a sense of collective ownership of the challenge to overcome.</li><li><em>Outcomes</em>: co-design actions are creative, practical, and outcome-oriented. Defining objectives plays a key role.</li><li>Cear definitions for co-design do not exist, especially for government service delivery. Nevertheless, for instance regarding smart cities, <strong>co-design can be viewed as </strong>(Sherriff, 2015):<br>- focusing on stakeholder needs instead of what technology can do to,<br>- reforming services, and<br>- engaging stakeholders in a specific way.</li></ul><p>Moreover, <strong>co-design is characterized by three dimensions</strong> (Sherriff, 2015):</p><ul><li><em>horizontal movement</em>: cooperating with colleagues from parallel organisations in the same region or in another.</li><li><em>vertical movement</em>: working with stakeholders on different services across the chain level.</li><li><em>intensity</em>: fact-finding involvement by forming the results with the citizens.</li></ul><p><strong>Virtual design and prototyping tools</strong></p><p>Citizen contributions are powerful. In addition to creating new ideas and solving issues, for instance, turning conceptual solutions into specific designs for implementation can be also facilitated. This method of co-design is becoming increasingly popular because of several advantages delivered by web-based tools (e.g. support of sharing information, visualisation, virtual prototyping, and collaborative idea building). Web-based virtual co-design and prototyping instruments are used to establish an idea, design and develop a prototype. By using this, citizens can create new concepts together and detail these ideas on design boards online. Stakeholders can articulate and visualise their own solutions (Sherriff, 2015). Because creativity plays a crucial role throughout the processes, this method also shows great potential to facilitate the entrepreneurial discovery process.</p><p>“Citizens as Partners: OECD Handbook on Information, Consultation and Public Participation in Policy-Making” was published by the Organisation for Economic Co-operation and Development (OECD). This guide highlights government-citizens-relationships in democracy. It also inspects the relationships in policy-making on the local, national, and international levels emphasising that representative democracy is based on rules and principles which should guide the interactions among the government and the citizens. In the handbook ways are described how the interactions can be strengthened (Gramberger, 2001). In this framework, active participation plays a key role. Citizens are involved in the decision-making and policy-making process, which is an advanced two-way relationship (Lironi, 2016). Co-design facilitates these vital interactions.</p><p>A framework was created by the United Nations (UN) for e-participation to strengthen government-citizen interactions (United Nations, 2014), such as E-decision-making (Empowering citizens through co-design of policy options and co-production of service components and delivery modalities) (Lironi, 2016).</p><p>The aim of e-participation initiatives is to “improve citizens’ access to information and public services and to promote participation in public decision-making which impacts the well-being of society, in general, and the individual, in particular” (United Nations, 2014; Lironi, 2016, p. 13).</p><p>How intensively stakeholders can be involved when using the online tools can be determined by <strong>three levels of e-participation</strong> (Macintosh, 2004):</p><ul><li><em>E-enabling</em> means that people who typically would not have internet access and take advantage of the information should be supported. This level also discusses the use of technology to reach more people and offer more accessible and clear information. E-enabling focuses on <em>accessibility and understandability</em>.</li><li><em>E-engaging</em> with citizens concentrates on consulting a larger audience to allow contributions and to support deliberative debates on policy problems. In particular, e-engaging refers to e-participation of citizens in <em>consultation by using a top-down approach</em>.</li><li><em>E-empowering</em> citizens is about supporting participation and simplifying bottom-up ideas to affect the political agenda. Stakeholders become <em>consumers and producers of policies</em> and therefore can co-design the creation of policies (Lironi, 2016).</li></ul><p>Results showed that the co-design method represents a learning process for citizens and decision-makers, supports new and innovative ideas to shape policies, and increases the legitimacy of policy-making. Overall, crowdsourcing has the potential to improve legitimacy by generating more trust in the process of decision-making within defining the policy-mix. Thus, if the participants did not receive the desired result, they would still keep their faith in the fair system. The European Union (EU) is strengthening the notion of stakeholder engagement (Warren, 2009; Lironi, 2016).</p><p><strong>Existing projects</strong></p><p>Stakeholder engagement in the policy mix processes — cooperating with each other and accomplishing consensus — is spreading throughout the world. It creates vital advantages (Irvin and Stansbury, 2004). The “European Citizens Initiative” (ECI) is a tool of participatory democracy in the European Union. ECI’s objective is to engage stakeholders directly in the policy mix process in the EU (EU, 2011; Lironi, 2016). The platform <a href="http://www.puzzledbypolicy.eu/">www.puzzledbypolicy.eu</a> was established to invite stakeholders to take part in various policy-making stages that follow the inform-consult-empower framework. The idea of the framework is that the citizen involvement begins with wanting to know more about policies and then discussing them. When they are informed, they primarily discuss existing policies instead of creating new ones (Sánchez-Nielsen et al., 2014; Lironi, 2016).</p><p><strong>Learning about e-participation platforms</strong></p><p>The concept of liquid democracy is a “model of democracy that combines representative and direct democracy and tries to even out the difficulties in both models” (Jansen, 2013; Lironi, 2016, p. 42). To know how to connect with a community, it is vital to know what the already existing instruments for participatory democracy are. Thus, a Liquid Democracy meeting was organised in November 2014 where experts and developers on liquid democracy presented their tools and theories (Reda, 2014). In addition, there were debates on challenges of participation systems, for example, accreditation, transparency, anonymity or real name policies, usability, and the potential of gamification (Lironi, 2016). In this context, “Cbased” (Cbased, 2016) develops toolkits for participatory decision-making processes. Cbased supported the implementation of the tool “Discuto” (Discuto, 2016) to open the procedure to the public (Lironi, 2016). The online platform Discuto “helps you make better decisions” (Discuto, 2016; Lironi, 2016, p. 42) and therefore includes many functions, for example, instant discussions, real-time, scalable polls, instant feedback, etc. Here, every paragraph of the report can be commented on and be voted on for two months (Cbased, 2015; Lironi, 2016).</p><p>The Discuto e-participation tool is seen as a successful project. Nevertheless, there are challenges that are still unsolved regarding the usage of digital tools for citizen involvement in decision-making while co-designing a policy-mix. The main challenge is to <strong>boost the participation of the citizens</strong> (Reda, 2016). Overall, e-information should go together with e-participation, which needs more effort. Intermediaries could play a vital role in facilitating the procedure of e-information to let the citizens be more informed and involved in e-consultations and other e-participation types (Lironi, 2016).</p><p><strong>The strengths of this co-designing method for policy-mix include </strong>(Lironi, 2016):</p><ul><li>Encouraging participation and active citizenship.</li><li>Offering citizens a policy agenda-setting power.</li><li>Supporting stakeholders to learn about decision-making and political processes.</li><li>Minimising the democratic deficit by connecting stakeholders.</li></ul><p><strong>Collaborative policy-mix making</strong></p><p>The method can be used to involve stakeholders in writing political manifestos, defining policy mixes and priorities, determining the allocation of budgets, and participating the political process of decision-making. Political parties, cities, local councils, members of Parliaments, community groups, and several organisations already tested existing tools for this method such as D-CENT. Overall, creating policies via co-creation results in processes and outcomes that will be more open, more clear, and more cooperative (D-CENT, 2016).</p><p>For RIS3 it is vital to involve a diverse set of stakeholders within a co-design process for a policy-mix. So, this type of method can be used to receive feedback on policies, different agendas and programmes to make the design process easier. Additionally, the stakeholders can vote on the drafts and add comments to improve it. Co-design could support focus on new (entrepreneurial) ideas as more people are involved and engaged.</p><h3>Usability and impact</h3><p>Co-design can result in receiving more feedback and ideas from the public for a better RIS3 result. Furthermore, additional (entrepreneurial) information on the region is also gained. As a result, the stakeholder and citizens of the region or nation feel more involved in the RIS processes since they are able to add their opinions in the co-design process of RIS3. This method also encourages “quiet” individuals to share their feedback as every opinion is weighted equally. Additionally, this method and tool should be easy to use from everywhere, at any time. Many cities and countries have implemented existing tools such as D-Cent and have gained much more information on specific topics. Nevertheless, particular effort has to be taken to inform stakeholders of the possibilities for becoming part within the design of RIS3. Additionally, stakeholders need to be introduced to relevant S3 topics.</p><h3>Required data</h3><p>To implement the method via a tool such as D-CENT — knowledge of Object 8, Clojure (JVM-based language) is required,, because this programme is written in this language. Knowledge in PostgreSQL is also essential because this is the type of database the data is stored in. Furthermore, the tool supports authentication through Facebook, Twitter, and Stonecutter by using the OpenID Connect specification. So for the user, a Facebook account, Twitter account, or an email registration is necessary to access the co-design tool. For the email registration, a username, email, and password is needed. Additionally, feedback and ideas for the co-design phase are necessary from the users.</p><h3>Relevant data sources</h3><p>For more information regarding the project D-CENT please follow this link:</p><ul><li><a href="http://dcentproject.eu/">http://dcentproject.eu/</a></li></ul><p>For the existing application Object 8 this document provides additional information:</p><ul><li><a href="http://tools.dcentproject.eu/pdfs/Collaborative-policy-making.pdf">http://tools.dcentproject.eu/pdfs/Collaborative-policy-making.pdf</a></li></ul><p>To implement the project itself, the code and the implementation roadmap can be found via the following link:</p><ul><li><a href="http://github.com/d-cent/objective8">http://github.com/d-cent/objective8</a></li></ul><p>The Object 8 tool is written in Clojure (JVM-based language). The database used is PostgreSQL.</p><h3>Implementation roadmap</h3><p>The first step is to download the code from <a href="http://github.com/d-cent/objective8">http://github.com/d-cent/objective8</a> and to download these programmes:</p><ul><li>VirtualBox,</li><li>Vagrant, and</li><li>Ansible.</li></ul><p>The full instruction is provided here: <a href="http://github.com/d-cent/objective8">http://github.com/d-cent/objective8</a></p><h3>References</h3><ul><li>Cbased — Open Innovation Consulting. (2016). Retrieved November 2016 from <a href="https://www.cbased.com/">https://www.cbased.com/</a></li><li>Evaluation of the EU Copyright Directive. (2015). Retrieved November 2016 from <a href="https://www.discuto.io/en/consultation/6240?page=2">https://www.discuto.io/en/consultation/6240?page=2</a></li><li>D-CENT. (2016). D-CENT ToolBox: Technologies for 21st century democracy. Retrieved November 2016 <a href="http://tools.dcentproject.eu/pdfs/D-Cent-final-spreads.pdf">http://tools.dcentproject.eu/pdfs/D-Cent-final-spreads.pdf</a></li><li>Discuto.io. (2016). Retrieved November 2016 from <a href="https://www.discuto.io/">https://www.discuto.io/</a></li><li>European Parliament and the Council Regulation (EU) 211/2011 of 16 February 2011 on the citizens’ initiative. (2011). Retrieved November 2016 from <a href="http://eur-lex.europa.eu/">http://eur-lex.europa.eu/</a></li><li>ECAS. (2014). The European Citizens’ Initiative Registration: Falling at the first hurdle? Retrieved November 2016 from <a href="http://www.ecas.org/wp-content/uploads/2014/12/ECI-report_ECAS-2014_1.pdf">http://www.ecas.org/wp-content/uploads/2014/12/ECI-report_ECAS-2014_1.pdf</a></li><li>Gramberger, M. (2001). Citizens as Partners OECD Handbook on Information. Consultation and Public Participation in Policy-making, Paris: Organisation for Economic Co-operation and Development.</li><li>Jansen, A. M. (2013). Liquid Democracy: Counteracting Democratic Deficits in German Politics, Saarbrücken: Lap Lambert Academic Publishing GmbH KG.</li><li>Irvin, R. A., and Stansbury, J. (2004). Citizen participation in decision making: is it worth the effort?. Public Administration Review, 64(1), 55–65.</li><li>Lironi, E. (2016). Potential and Challenges of E-participation In the European Union: Study. European Citizen Action Service, Brussels: European Union. Retrieved November 2016 from <a href="http://www.europarl.europa.eu/RegData/etudes/STUD/2016/556949/IPOL_STU(2016)556949_EN.pdf">http://www.europarl.europa.eu/RegData/etudes/STUD/2016/556949/IPOL_STU(2016)556949_EN.pdf</a></li><li>Macintosh A. (2004). Characterizing e-participation in policy-making, in: Proceedings of 37th Hawaii International Conference on System Sciences, 1–10.</li><li>Reda, J. (2014). Liquid Democracy. Retrieved November 2016 from <a href="https://juliareda.eu/events/liquid-democracy-meetup/">https://juliareda.eu/events/liquid-democracy-meetup/</a></li><li>Reda J. (2016). Reda Report draft — explained. Retrieved November 2016 from <a href="https://juliareda.eu/copyright-evaluation-report-explained/">https://juliareda.eu/copyright-evaluation-report-explained/</a></li><li>Sánchez-Nielsen, E., Lee, D., Panopoulou, E., Delakorda, S., and Takács, G. (2014). Engaging Citizens in Policy Issues: Multidimensional Approach, Evidence and Lessons Learned. in International Conference on Electronic Participation. Berlin Heidelberg: Springer Verlag, 102–113.</li><li>Sherriff, L. (2015). Sensing the Future: How will smart city principles and technology enable citizen co-creation in public policy-making, consent processing and service provision. Retrieved November 2016 from <a href="http://www.align.net.nz/wp-content/uploads/2014/02/Sensing-the-Future-Laurence-Sherriff.pdf">http://www.align.net.nz/wp-content/uploads/2014/02/Sensing-the-Future-Laurence-Sherriff.pdf</a></li><li>The World Bank (2016). Toward an innovative Poland: The entrepreneurial discovery process and business needs analysis. Poland: Ministry of Economic Development. Accessed on 08.11.2016 <a href="http://documents.worldbank.org/curated/en/801221468186841613/pdf/106148-REPLACEMENT-v2-English-REPORT-Web.pdf">http://documents.worldbank.org/curated/en/801221468186841613/pdf/106148-REPLACEMENT-v2-English-REPORT-Web.pdf</a></li><li>Tuzzi, A., Padovani, C., and Nesti, G. (2007). Communication and (e)democracy: assessing European edemocracy discourses, in: Cammaerts B. and Carpentier N (editors). Reclaiming the media. Communication rights and democratic media roles. Bristol, UK, Chicago, USA, Intellect, 31–65.</li><li>United Nations (2014). United Nations E-Government Survey 2014: E-Government for the future we want. New York: United Nations Department of economic and social affairs.</li><li>Warren, M. E. (2009). Citizen participation and democratic deficits: considerations from the perspective of democratic theory. Activating the Citizen. UK: Palgrave Macmillan, 17–40.</li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8891944cd030" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/5-2-ris3-action-plan-co-design-8891944cd030">5.2. RIS3 action plan co-design</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[5.3. RIS3 budgeting]]></title>
            <link>https://medium.com/onlines3-consultation/5-3-ris3-budgeting-54b7a0839805?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/54b7a0839805</guid>
            <category><![CDATA[policy-mix]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Mon, 19 Dec 2016 18:52:13 GMT</pubDate>
            <atom:updated>2017-01-25T11:42:21.448Z</atom:updated>
            <content:encoded><![CDATA[<h4>The method will provide a framework for using different budgeting methods (incremental, zero budgeting) to capture the funding dimension of the RIS3 action plan and the needs for funding across the defined implementation period.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/1*8AMAZ13okCJZN2YMR8_bJg.png" /></figure><p>The method will provide a framework for identifying, using and combining different budgetary sources to capture the funding dimension of the RIS3 action plan and the needs for funding during the implementation period. Users will be able to access information the potential sources of funding and indicate the allocation of funds by policy measure/action line.</p><p>One of the S3 aims is to foster more effective spending of public resources, by concentrating on priority areas for knowledge-based investments, focusing on the strengths and comparative advantages of each region. Budgeting is an important tool as it assists RIS3 partnerships to identify what resources are available in shaping and implementing the smart specialisation action plan. The <em>Guide to Research and Innovation Strategies for Smart Specialisations (RIS 3) </em>(2012)<em> </em>refers to “the four Cs of smart specialisation”. The first one is “<em>(Tough) Choices and Critical mass”</em> and refers to the need to limit the “number of priorities based on own strengths and international specialisation — avoid duplication and fragmentation — concentrate funding sources ensuring more effective budgetary management” (European Commission, 2012).</p><p>Furthermore, budgetary resources and budgeting are part of the RIS3 ex-ante conditionality. It requires EU Member States and regions to have smart specialisation in place that:</p><ul><li>sees a Member State has adopted a framework outlining available budgetary resources for research and innovation; and</li><li>a Member State has adopted a multi-annual plan for budgeting and prioritisation of investments linked to EU priorities (European Strategy Forum on Research Infrastructures –ESFRI).” (European Commission, 2014)</li></ul><p>However, a European Commission Expert Group (2015) found that “Many of the RIS3 assessed did not provide a detailed budget as requested by the ex-ante conditionality. There seem to be an assumption that the RIS3 budget will be equal to the ERDF OP earmarked budget for R&amp;D activities. This does not guarantee, however, that enough funds will be available to implement the RIS3, e.g. if arbitration is needed between different policies”. An example of an initial RIS3 budget for the Czech Republic is provided in annex.</p><p>The road to successfully implementation of a smart specialisation action plan, necessitates good planning and coordination of stakeholders and resources. An OECD report (2013) argued that one of the main issues in implementing a successful smart specialisation action plan is that policy priorities are rarely translated into policy instruments and into public budget allocations:</p><blockquote><em>… the absence of a clear view on public allocations to prioritized areas, as revealed by the enquiry, prevents policy-makers to assess the relevance and effectiveness of their policies.</em></blockquote><p>A clear link between priorities, policy instruments and budget is important as clear budgeting can help guide the choice of instruments used in the action plan (Nauwelaers, et al., 2015). Knowledge about the available budget and financing sources assists in the choice of appropriate instruments, which in turn is also dependent on the specific regional policy funding context (European Commission, 2012). Budgeting should also take account of various EU funding sources and the potential synergies between different sources (European Commission, 2014).</p><p>In the process of budgeting, it is necessary to identify all available funding, especially from the private sector that can leverage public sources. It is also important in setting the priorities for the S3 action plan, to include as many stakeholders as possible as the both the government and the industry have imperfect information on their own. Hence, cooperation becomes vital and an “inclusive and interactive bottom-up process in which participants from different environments” (European Commission, n.d.) needs to be created.</p><p>A transparent and updated budgetary planning framework can also assist in developing an effective procurement schedule for the RIS3 action plan. It can help “To guide procurers to join forces with others, in order to attain critical mass, making it interesting for firms to develop innovative solutions for a bid and in order to pool capacities (legal, procedural, knowledge of market, technologies and performance levels, administrative budgets for the procurement processes, etc.)” (European Commission, 2012).</p><p>The baseline budget can also be used as an indicator for on-going budget allocation and expenditure, e.g. are expenditures of the programme in line with the planned budget. Furthermore, this information feeds into monitoring and evaluation processes. Flanders in Belgium, for instance, used it as part of the impact scan methodology to monitor the regional innovation budget. Information on both the total amount spent on regional innovation as well as in-depth knowledge of the distribution of this money by policy objectives, intermediaries and services are needed (Nauwelaers, et al., 2015).</p><p>The Guide on Research and Innovation Strategies for Smart Specialisation (RIS3) (2012) gives guidelines on what needs to consider when budgeting a S3. For instance:</p><ul><li>Does the strategy identify appropriate actions covering the proposed policy mix?</li><li>Is there sector- or priority- specific support services/schemes foreseen?</li><li>Does the strategy identify budgetary sources, and does it present indicative budget allocations?</li><li>Does the strategy create synergies between different policies and funding sources?</li><li>How does it align/leverage EU/national/regional policies to support upgrading in the identified areas of current and potential future strength? (European Commission, 2012)</li></ul><p>The OECD (2013) recommends to develop a ‘Smart Specialisation-oriented’ public budget calculation that provides a picture of budgets allocated to each prioritised area by aggregating:</p><ul><li>Budgets allocated to dedicated bodies and programmes (institutes, centres, R&amp;D programmes, clusters, etc.);</li><li>Budgets allocated through preferential treatment in generic programmes;</li><li>Ex-post funding received by prioritised areas from generic programmes.</li></ul><p>At regional level, these types of budgets should include, besides budgets from regional origin, also national funding sources available to the prioritised areas, as well as funding of EU origin. (OECD, 2013) The publication Regional Policy for smart growth in Europe 2020 (European Union, 2011) has a chapter on “financial engineering support” and discusses the different types of funding, e.g. non-repayable grants, loans, venture capital, guarantees and other forms of financial engineering.</p><p>In short, the budgeting methods adopted need to provide:</p><ul><li>A multi-annual view on financial resources to be mobilised</li><li>A means of distinguishing between specific/vertical measures entirely or largely targeting S3 priorities and ‘generic’ or horizontal’ measures that may provide funding to contribute to S3 measures</li><li>A disaggregation by source of funding (national and/or regional public funds, national and/or regional private funds (businesses, charitable foundations, etc.),</li><li>Potentially identify synergies between monetary, in-kind (e.g. organisations that will provide staff to support implementation) and legal/regulatory instruments.</li></ul><h3>Description of the method</h3><p>The method will provide a framework for preparing and updating RIS3 budgets based on the sources of funding and committed versus actual expenditure. The method will support RIS3 partnerships and managers in handling the funding dimension of the RIS3 action plan and on-going financial planning during the implementation period. The sources of funding and allocation of funds by type of measure, beneficiary and type of financial instruments will be captured. There are a wide range of budgeting methods and procedures which very much depends on national standard and practices (see OECD, 2014). Hence, the method and related tools will provide a harmonised tool that enables comparison of RIS3 budgets and policy mixes at European level. The tool will not to provide a financial or budgetary planning tool adapted to specific national budgeting rules or accounting procedures.</p><p>The tables on the following pages provides a sketch of example of ‘nested tables’ that would be available via the tool and would generate an online overview of budgetary planning for regions. The tables will be downloadable in Excel, CSV or PDF format. The set of tables will be built up from the ‘policy measure’ (programme, initiative, etc.) level by RSI3 managers entering data into tables and coding the information on planned, committed and spent budgets by various categorisations:</p><p><strong>The categories defined by the Commission Implementing Regulation (EU) No 215/2014 of 7 March 2014</strong> (<a href="http://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32014R0215)">http://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32014R0215)</a>, namely:</p><ul><li>Thematic objective</li><li>Intervention code</li><li>Forms of finance</li></ul><p>And by <strong>funding source (private, national/regional public funds, ESIF, Horizon 2020, etc.).</strong></p><p>In certain cases, it may also be relevant to capture qualitative information on related non-financial support such as legal/regulatory changes underpinning financial interventions. This could be captured through a comment function allowing users to input notes or additional information.</p><p>In the case where funding sources are competitive or not yet confirmed, it is useful to provide at least a qualitative positioning analysis with respect to additional funding sources for the main S3 measures, initiatives or key organisations (clusters). An example from the Walloon (Belgium) S3 strategy is provided below where the Walloon competitiveness clusters are aligned with EU level platforms.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*HPGjfPEyp4aaRZ93HQvbYQ.png" /></figure><p>The OnlineS3 budgeting tool could include an additional application to enable regions to map key regional/national organisations/clusters with respect to European partnerships or initiatives.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*c6N7PgJiaiVTqgDt0o454Q.png" /><figcaption>Overall RIS3 financial plan: funding sources and form of finance by RIS3 priority</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*uI-XhjXudHTICrjozoR10Q.png" /><figcaption>Overall RIS financial plan: ESI Funding only — by intervention field and form of funding</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*mAbAtyFimHcA0SYg760KHQ.png" /><figcaption>Overall RIS financial plan: source of funding</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*2-rNE1nu2KzRNpnFId6eFg.png" /><figcaption>RIS financial plan — priority level (one table per priority) : funding source and form of finance</figcaption></figure><p>(*) see lists of proposed categories in annex</p><h3>Usability and impact</h3><p>The quasi-absence of detailed budget plans in the initial RIS3 strategies has led to a further round of RIS3 action plans during which Member States and regions are requested to provide, amongst other information, more detailed budgeting plans. This tool will support the process of improving budgeting, planning of financial resources, identification of synergies between sources of funds, the extent to which RIS3 are leveraging private finance, etc. The tool will create a complementary and more detailed dataset to the data collected for ESI Fund purposes by managing authorities. It should also provide a means for strategic monitoring of RIS3 as they are implemented as actual versus planned funding/expenditure can be compared over time.</p><p>The tool will fill a clear gap for users (RIS3 managers and stakeholders) in the current ‘toolkit’ available and should lead to a more harmonised, and therefore, comparable approach to budgeting RIS3. This will be of strategic value at both national and EU levels for future evaluation and reporting purposes.</p><h3>Required data</h3><p>RIS3 managers should be able to access information on the funding spent on relevant S3 and innovation policy initiatives and have a thorough knowledge of the distribution of this money by policy priorities, intermediaries and services (Nauwelaers et al., 2015). When designing monitoring and evaluation activities for smart specialisation, both for the priority-setting and evaluation of programmes, governments may want to develop a pilot exercise on “implementing ‘Smart specialisation-oriented’ public budget pictures of budgets allocated to each prioritised areas by aggregating: i) Budgets allocated to dedicated bodies and programmes (e.g. institutes, centres, R&amp;D programmes, clusters); ii) budgets allocated through preferential treatment in generic programmes; iii) ex post money received by prioritised areas in generic programmes.” (OECD, 2013).</p><h3>Relevant data sources</h3><p>The ESI Fund managing authorities have a legal obligation to collect and categorise data and this data is compiled by DG REGIO and made available for research and analysis purposes:</p><ul><li><a href="http://ec.europa.eu/regional_policy/en/policy/evaluations/data-for-research/">http://ec.europa.eu/regional_policy/en/policy/evaluations/data-for-research/</a></li></ul><p>DG JRC has developed an ESIF-viewer, visualising planned investments using European Structural and Investment Funds:</p><ul><li><a href="http://s3platform.jrc.ec.europa.eu/esif-viewer">http://s3platform.jrc.ec.europa.eu/esif-viewer</a></li></ul><p>However, the tool will essentially be fed by data uploaded directly by RIS3 managers or monitoring and evaluation teams. Hence, there is a need to foresee an online login function so that data entered for a specific region or Member State is protected from unauthorised changes.</p><h3>Implementation roadmap</h3><p>The implementation of the budget tool will require, at least, the following steps:</p><ol><li>Agreement on the categorisations to be used when developing the budget tools, e.g. should the ESF secondary intervention codes be included, should there be a possibility to code budgets by industrial (NACE) or scientific/technological classifications, etc.</li><li>Development of the required set of nested tables through a co-design process with managing authorities or relevant public agencies (e.g. Scottish Enterprise, etc. in Scotland) in the pilot regions</li><li>Consultation with DG REGIO statistical unit to ensure complementarity and alignment with existing ESI Fund data sets</li><li>Development of an online tool with a login function allowing identified users to upload data on RIS3 budgets for their region/country.</li></ol><h3>References</h3><ul><li>European Union. (2011). Regional Policy for smart growth in Europe 2020. European Commission, Directorate-General for Regional Policy. Brussels: European Union. <a href="http://dx.doi.org/10.2776/39233">doi:10.2776/39233</a></li><li>European Commission. (2012). Guide on Research and Innovation Strategies for Smart Specialisation (RIS3). Publications Office of the European Union. Luxembourg: European Union. <a href="http://dx.doi.org/10.2776/65746">doi:10.2776/65746</a></li><li>European Commission. (2014). Enabling synergies between European Structural and Investment Funds, Horizon 2020 and other research, innovation and competitiveness-related Union programmes — Guidance for policy-makers and implementing bodies. Directorate-General for Regional and Urban policy. Luxembourg: Publications Office of the European Union. <a href="http://dx.doi.org/10.2776/84939">doi:10.2776/84939</a></li><li>European Commission. (2014, March). National/Regional Innovation Strategies for Smart Specialisation (RIS3). <a href="http://dx.doi.org/10.2776/20697">doi:10.2776/20697</a></li><li>European Commission (2015) Perspectives for Research and Innovation Strategies for Smart Specialisation (RIS3) in the wider context of the Europe 2020. Report of an expert group. doi: <a href="http://dx.doi.org/10.2777/872170">10.2777/872170</a></li><li>European Commission. (n.d.). Entrepreneurial Discovery Process — EDP. Retrieved November 15, 2016, from Smart Specialisation Platform S3: <a href="http://s3platform.jrc.ec.europa.eu/entrepreneurial-discovery-edp">http://s3platform.jrc.ec.europa.eu/entrepreneurial-discovery-edp</a></li><li>Nauwelaers, C., Blazek, J., Magro, E., McCann, P., Morgan, K., Ortega-Argiles, R., &amp; Wilson, J. (2015). Underpinning effective strategy design. [Working Paper]. School of Planning and Geography Working Papers. Cardiff: Cardiff University. Retrieved from <a href="http://orca.cf.ac.uk/id/eprint/78220">http://orca.cf.ac.uk/id/eprint/78220</a></li><li>OECD. (2013). Innovation-driven Growth in Regions: The Role of Smart Specialisation. Paris: OECD Publications. Retrieved from OECD: <a href="http://www.oecd.org/sti/inno/smartspecialisation.htm">http://www.oecd.org/sti/inno/smartspecialisation.htm</a></li><li>OECD. (2014). Budgeting Practices and Procedures in OECD Countries. Paris: OECD Publishing. doi:<a href="http://dx.doi.org/10.1787/9789264059696-en">10.1787/9789264059696-en</a></li></ul><h3>Categories for budget tables</h3><p><strong>Forms of funding (indicative list, to be further developed):</strong></p><ul><li>Private (business) contribution</li><li>National public funds</li><li>Regional public funds</li><li>Charitable or other national/regional sources</li><li>ERDF: European Regional Development Fund</li><li>ESF: European Social Fund</li><li>EAFRD: European Agricultural Fund for Rural Development</li><li>EMFF: European Maritime and Fisheries Fund</li><li>European Fund for Strategic Investments (EFSI)</li><li>Research Framework Programme (currently Horizon 2020) — potentially broken down by sub-programme</li><li>European Institute of Innovation and Technology (EIT) — Knowledge and Innovation Communities (KIC).</li><li>European Innovation Partnerships</li><li>Connecting Europe Facility (CEF)</li><li>Competitiveness of Enterprises and Small and Medium-sized Enterprises (COSME)</li><li>LIFE</li><li>Creative Europe</li><li>Employment and Social Innovation (EaSI) programme</li><li>Erasmus+</li><li>Third EU Health programme</li></ul><p><strong>THEMATIC OBJECTIVE (ERDF and the Cohesion Fund)</strong></p><p>01 Strengthening research, technological development and innovation</p><p>02 Enhancing access to, and use and quality of, information and communication technologies</p><p>03 Enhancing the competitiveness of small and medium-sized enterprises</p><p>04 Supporting the shift towards a low-carbon economy in all sectors</p><p>05 Promoting climate change adaptation, risk prevention and management</p><p>06 Preserving and protecting the environment and promoting resource efficiency</p><p>07 Promoting sustainable transport and removing bottlenecks in key network infrastructures</p><p>08 Promoting sustainable and quality employment and supporting labour mobility</p><p>09 Promoting social inclusion and combating poverty and any discrimination</p><p>10 Investing in education, training and vocational training for skills and lifelong learning</p><p>11 Enhancing the institutional capacity of public authorities and stakeholders and an efficient public administration</p><p>12 Not applicable (Technical assistance only)</p><p>13 Multi-thematic objective</p><p>1. <strong>INTERVENTION FIELD — (full list in implementing regulation) — the main fields likely to be relevant for S3 strategies include but all fields will be available in tool:</strong></p><p>I. <strong>Productive investment:</strong></p><p>001 Generic productive investment in small and medium — sized enterprises (‘SMEs’)</p><p>002 Research and innovation processes in large enterprises</p><p>003 Productive investment in large enterprises linked to the low-carbon economy</p><p>004 Productive investment linked to the cooperation between large enterprises and SMEs for developing information and communication technology (‘ICT’) products and services, e-commerce and enhancing demand for ICT</p><p><em>Sustainable transport</em></p><p>043 Clean urban transport infrastructure and promotion (including equipment and rolling stock)</p><p>044 Intelligent transport systems (including the introduction of demand management, tolling systems, IT monitoring, control and information systems)</p><p>Information and communication technology (ICT) infrastructure</p><p>045 ICT: Backbone/backhaul network</p><p>046 ICT: High-speed broadband network (access/local loop; &gt;/= 30 Mbps)</p><p>047 ICT: Very high-speed broadband network (access/local loop; &gt;/= 100 Mbps)</p><p>048 ICT: Other types of ICT infrastructure/large-scale computer resources/equipment (including e-infrastructure, data centres and sensors; also where embedded in other infrastructure such as research facilities, environmental and social infrastructure)</p><p><em>Research and development and innovation</em></p><p>056 Investment in infrastructure, capacities and equipment in SMEs directly linked to research and innovation activities</p><p>057 Investment in infrastructure, capacities and equipment in large companies directly linked to research and innovation activities</p><p>058 Research and innovation infrastructure (public)</p><p>059 Research and innovation infrastructure (private, including science parks)</p><p>060 Research and innovation activities in public research centres and centres of competence including networking</p><p>061 Research and innovation activities in private research centres including networking</p><p>062 Technology transfer and university-enterprise cooperation primarily benefiting SMEs</p><p>063 Cluster support and business networks primarily benefiting SMEs</p><p>064 Research and innovation processes in SMEs (including voucher schemes, process, design, service and social innovation)</p><p>065 Research and innovation infrastructure, processes, technology transfer and cooperation in enterprises focusing on the low carbon economy and on resilience to climate change</p><p><em>Business development</em></p><p>066 Advanced support services for SMEs and groups of SMEs (including management, marketing and design services)</p><p>067 SME business development, support to entrepreneurship and incubation (including support to spin offs and spin outs)</p><p>068 Energy efficiency and demonstration projects in SMEs and supporting measures</p><p>069 Support to environmentally-friendly production processes and resource efficiency in SMEs</p><p>070 Promotion of energy efficiency in large enterprises</p><p>071 Development and promotion of enterprises specialised in providing services contributing to the low carbon economy and to resilience to climate change (including support to such services)</p><p>072 Business infrastructure for SMEs (including industrial parks and sites)</p><p>073 Support to social enterprises (SMEs)</p><p>074 Development and promotion of commercial tourism assets in SMEs</p><p>075 Development and promotion of commercial tourism services in or for SMEs</p><p>076 Development and promotion of cultural and creative assets in SMEs</p><p>077 Development and promotion of cultural and creative services in or for SMEs</p><p><em>Information and communication technology (ICT) — demand stimulation, applications and services</em></p><p>078 e-Government services and applications (including e-Procurement, ICT measures supporting the reform of public administration, cyber-security, trust and privacy measures, e-Justice and e-Democracy)</p><p>079 Access to public sector information (including open data e-Culture, digital libraries, e-Content and e-Tourism)</p><p>080 e-Inclusion, e-Accessibility, e-Learning and e-Education services and applications, digital literacy</p><p>081 ICT solutions addressing the healthy active ageing challenge and e-Health services and applications (including e-Care and ambient assisted living)</p><p>082 ICT Services and applications for SMEs (including e-Commerce, e-Business and networked business processes), living labs, web entrepreneurs and ICT start-ups)</p><p><strong>Form of finance</strong></p><p>01 Non-repayable grant</p><p>02 Repayable grant</p><p>03 Support through financial instruments: venture and equity capital or equivalent</p><p>04 Support through financial instruments: loan or equivalent</p><p>05 Support through financial instruments: guarantee or equivalent</p><p>06 Support through financial instruments: interest rate subsidy, guarantee fee subsidy, technical support or equivalent</p><p>07 Prize</p><h4>Example of a RIS3 financial plan — ESI Funds only from Czech Republic RIS3 (December 2014)</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*o5GuTrI7dOuQB99VrEI2uA.png" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=54b7a0839805" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/5-3-ris3-budgeting-54b7a0839805">5.3. RIS3 budgeting</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[5.4. State aid law compliance for RIS3 implementation]]></title>
            <link>https://medium.com/onlines3-consultation/5-4-ris3-administrative-framework-conditions-4b9fc7197adf?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/4b9fc7197adf</guid>
            <category><![CDATA[policy-mix]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Mon, 19 Dec 2016 18:50:12 GMT</pubDate>
            <atom:updated>2017-02-08T18:43:29.432Z</atom:updated>
            <content:encoded><![CDATA[<h4>The method will define a catalogue of framework conditions for funding and implementing the RIS3 action plan.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/1*WrMoJneF7E5S--SBnx8YhQ.png" /></figure><p>State aid law<strong> </strong>is part of EU competition law and aims at constraining the funding possibilities of public authorities to sustain competition within the internal market, i.e. the 28 Member States. As a rule, State aid is prohibited as it distorts normal market conditions. Nevertheless, the European Commission (EC) can qualify certain public interventions as compatible aid, in case they contribute to the common interest like environmental protection, innovation or investments in underdeveloped regions. In case of S3 implementation, the selection of the appropriate State aid rule is not a difficult task since the main aims of S3 largely overlap with the objectives of compliance with State aid rules (e.g. fostering growth, innovation, SMEs). Similarities can be found between the approach of the EU State aid policy’s common assessment principles and S3 principles. Thus, several objectives of a RIS3 action plan may be aligned to one or more State aid rules, and beneficiaries contributing to the implementation of S3 may be able to receive State aid<a href="#_ftn1">[1]</a>.</p><p>Innovation policies can be implemented by means of direct grants or financial engineering measures. Tax incentives can also play a role in the development of certain economic activities and fall under State aid of the European Commission. The understanding and clarity of State aid rules however still constitute a bottleneck for RIS3 implementation in many regions. It is necessary to assess the potential of implementation and the compatibility of the RIS3 action plan with respect to available funding from the OPs and other programmes to achieve sustainable RIS3 implementation.</p><h3>Description of the method</h3><p>The objective of this method is to provide management authorities and RIS3 partners with a better understanding of State aid regulations (and definitions) that affect innovation and that are relevant for RIS3 implementation (e.g. support to SMEs, clusters and research infrastructures). The method helps the user/policy maker to identify if the policy instruments included in the RIS3 policy mix/action plan are eligible for State aid (see Figure 1).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/831/1*SeZYriup6TwHbXN13PaVNQ.png" /><figcaption>Figure 1 Logic framework of State aid compliance (Source: <a href="http://s3platform.jrc.ec.europa.eu/state-aid">http://s3platform.jrc.ec.europa.eu/state-aid</a>)</figcaption></figure><p>In the framework for State aid for R&amp;D and innovation (European Commission, 2014), the EC identified a series of RDI measures for which State aid may, under specific conditions, be compatible with the internal market:</p><ul><li>R&amp;D project aid: fundamental research, industrial research, experimental development, feasibility studies (Article 25 General Block Exemption Regulation 2014–2020 (GBER))<a href="#_ftn2">[2]</a></li><li>Investment aid for the construction and upgrade of research infrastructure (Art. 26 GBER)</li><li>Investment aid, operating aid for innovation clusters (Art. 27 GBER)</li><li>Innovation aid to SMEs: aid for industrial property rights costs, aid for the secondment of highly qualified personnel, aid for innovation advisory and support services (Art. 28 GBER)</li><li>Aid for process and organisational innovation: implementation of a new or significantly improved production or delivery method (Art. 29 GBER)</li><li>SME access to finance: aid for ‘innovative’ start-ups: either innovativeness confirmed by external expert or R&amp;D costs representing minimum 10% of total operating costs (Art. 22 (5); Art. 2 №80 GBER).</li></ul><p>State aid received must remain under a series of notification thresholds to be eligible for GBER (Art. 4 GBER 2014. In the case of RDI aid, the notification thresholds are listed in Table 1 below.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*hO4BiXbIDNx4_qrW4vgkIw.png" /><figcaption>Table 1 Article 4 GBER 2014 notification thresholds for R&amp;D&amp;I aid (Source: Laiu et al., 2014)</figcaption></figure><p>In the case of aid for R&amp;D projects, eligible costs include expenditure for land, buildings, instruments and equipment, only to the extent and for the period used for the project. For industrial research projects, laboratory-scale prototypes and small scale pilot lines are also eligible; and there is no ex-post deduction of commercial revenues generated by prototypes and pilots from eligible costs. Moreover, different aid intensities exist varying by company size. In addition, there exist specific compatibility conditions for investment aid for the construction and upgrade of research infrastructure and innovation clusters.</p><p>It is a key part of Cohesion policy for 2014–2020 to increase administrative capacity in MS in the field of State aid. Under the (enlarged and simplified) 2014 GBER framework a large proportion of aid is under the control and responsibility of the Member States (MS); and a lesser share is under the control of the EC with stricter conditions. MS have flexibility on how to set up projects/schemes. For achieving State aid compliance, the Managing Authorities (Simon and Przeor, 2016):</p><ul><li>Should first discuss with their State aid contact points in national administrations.</li><li>Technical Assistance budget may be used for obtaining expert advice.</li><li>For advice on individual projects, MS may contact DG Competition of the European Commission for pre-notification talks.</li></ul><p>In the case that individual aid goes above the notification thresholds as defined in the RDI framework, an assessment criteria and process is defined focused on evaluation by Member States (Table 2).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*aJc3uJmSoKo3Keam6vysWg.png" /><figcaption>Table 2 Assessment principles and approach of large individual aid above the notification thresholds of the R&amp;D&amp;I framework (Source: Laiu et al., 2014)</figcaption></figure><h3>Usability and impact</h3><p>State aid is perceived as a problem because is often an unknown territory. The EC has highlighted the need to act in State aid, for several reasons<a href="#_ftn3">[3]</a>:</p><ol><li>The application of State aid rules has been identified as a potentially risky area in management of the European Structural and Investment Funds (ESIF);</li><li>2. Most parts of the State aid Modernisation Package entered in force on 1 July 2014, at the beginning of the 2014–2020 programming period, provided Member States with a clear of set rules but also increased the level of uncertainty on how to apply them;</li><li>3. The 2014–2020 period marks a clear shift of cohesion policy resulting in a higher number of projects where State aid is potentially involved.</li></ol><p>Several EC guidelines and documents have urged for the need to communicate complex procedures simply. The risk of clawback of state funds must be minimal to ensure confidence among stakeholders on the use of State aid. When aligned to one or more State aid rules, beneficiaries contributing to the implementation of S3 may be able to receive State aid and hence contribute to more efficient RIS3 implementation, particularly in regions with limited funds for policy support.</p><h3>Required data</h3><p>The key relevant data sources for design of RDI State aid logic framework are enlisted below:</p><ul><li>European Council Regulation 2015/1589 of 13 July 2015 <a href="http://eur-lex.europa.eu/legal-content/DE/TXT/?uri=uriserv:OJ.L_.2015.248.01.0009.01.ENG"><em>laying down detailed rules for the application of Article 108 of the Treaty on the Functioning of the European Union</em></a><em>. </em>Official legal text elaborating the general provisions of State aid.</li><li>European Commission Regulation No 651/2014 of 17 June 2014 <a href="http://eur-lex.europa.eu/legal-content/EN/TXT/?uri=uriserv%3AOJ.L_.2014.187.01.0001.01.ENG"><em>declaring certain categories of aid compatible with the internal market in application of Articles 107 and 108 of the Treaty</em></a> . Regulation describing the exemptions to the State aid rules, known also as General Block Exemption Regulation — GBER.</li><li>European Commission Communication C(2014) 3282, 21.5.2014 <a href="http://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A52014XC0627(01)"><em>Framework for state aid for research and development and innovation</em></a><em>. </em>Official EU document elaborating on the interpretations of state aid application to RDI.</li><li>European Commission (2015) <a href="http://ec.europa.eu/competition/state_aid/studies_reports/state_aid_grids_2015_en.pdf"><em>Analytical Grids on the application of State aid rules to the financing of infrastructure projects.</em></a> Staff working document, Grid No 4, September 2015. The document reflects the current rules and decision practices in application of State aid rules to construction and upgrade of research infrastructure and innovation clusters. The content does not prejudge possible developments in the State aid enforcement practice and the application of public procurement rules.</li><li>European Commission (2012) <a href="http://ec.europa.eu/regional_policy/en/information/publications/cocof-guidance-documents/2012/guidance-note-to-the-cocof-verification-of-compliance-with-state-aids-rules-in-infrastructure-cases"><em>Guidance Note to the COCOF on Verification of Compliance with State Aid Rules in Infrastructure Cases</em>.</a> Working document COCOF_12–0059–01, 21.11.2012 . The purpose of this note is to give guidance on the treatment of infrastructure projects under Cohesion policy rules.</li><li>European Commission (2015) <a href="http://ec.europa.eu/competition/state_aid/legislation/block.html"><em>General Block Exemption Regulation (GBER): Frequently Asked Questions</em></a><em>. A g</em>uide to GBER regulation meant to familiarise authorities and beneficiaries with the GBER and help them to apply the rules to their specific situation.</li></ul><h3>Relevant data sources</h3><p>The most relevant existing tool is the <strong>eStateAid-WIKI</strong> of DG Competition of the European Commission. The ‘<strong>eStateAid-WIKI</strong>’ is an IT-tool to facilitate informal exchanges on general State aid matters between the European Commission’s services and the Member States and EFTA countries (including the ESA). The <em>e</em>State aid WIKI does not encompass the exchange of information regarding specific cases, i.e. information about specific companies or individuals, for which other formal channels are in place.</p><p>Access to the <em>e</em>State aid WIKI is open to a limited number of users only, as controlled by DG COMP of the EC. Submitting a question is limited to a few authorities per Member State, while ‘read access’ is provided more widely. The Wiki represents a useful tool for increasing transparency on the interpretation of State aid rules.</p><p>The <strong>State aid Scoreboard</strong><a href="#_ftn4">[4]</a> of DG COMP comprises aid expenditure made by Member States which falls under the scope of Article 107(1) of the Treaty on the Functioning of the European Union (TFEU). The data is based on the annual reporting by Member States pursuant to Article 6(1) of Commission Regulation (EC) 794/2004. Expenditure refers to all existing aid measures to manufacturing industries, services, agriculture and fisheries, for which the Commission adopted a formal decision or received an information fiche from the Member States in relation to measures qualifying for exemption under the General Block Exemption Regulation.</p><p>As part of the State aid control, DG COMP allows to submit a <strong>complaint form online</strong> with regards compliance to EU rules and equal application of exemptions across the EU, here: <a href="http://ec.europa.eu/competition/forms/sa_complaint_en.html">http://ec.europa.eu/competition/forms/sa_complaint_en.html</a>.</p><h3>Implementation roadmap</h3><p>The proposed implementation roadmap is the following:</p><ol><li><strong>Data collection and analysis</strong>: this step includes the collection and analysis of all relevant data and cases related to the RDI State aid framework. This includes all the data listed above in the “Required data” section.</li><li><strong>Design of RDI State aid compliance logic framework</strong>: based on all State aid rules and regulations, and with the help and assistance of a competition lawyer and DG COMP and DG REGIO experts, a logic framework on the use of State aid in support of smart specialisation will be designed. This logical framework should consider all details included in the regulations and outlined in the section “Description of the method” above.</li><li><strong>Implementation of Online State aid quiz</strong>: once the logic framework is built, an online tool will be designed for regional policy makers and RIS3 Managing Authorities. The tool will guide the users through the main characteristics of State aid Law for RDI. It will also provide a question and answer quiz (multiple choice, closed questions) based on the logic framework. The output of the quiz will be a State aid diagnosis that identifies, if any of the policy instruments included in the RIS3 policy mix/action plan is eligible for State aid. It will also give information on ‘next steps’ and ‘what to do next’ to benefit from State aid, including relevant contact points.</li></ol><h3>References</h3><ul><li>European Commission (2012), <a href="http://ec.europa.eu/competition/state_aid/cases/244253/244253_1373480_139_2.pdf"><em>State aid — Italy. Measures to encourage risk capital investments in newly created enterprises</em></a><em>.</em></li><li>European Commission (2014), <a href="http://ec.europa.eu/competition/state_aid/modernisation/rdi_framework_en.pdf"><em>Communication from the Commission, Framework for State aid for research and development and innovation</em></a>.</li><li>Laiu R., Grozea C., Von Wendland B. (2014), <a href="http://www.jaspersnetwork.org/download/attachments/15433806/Jaspers%20State%20Aid%20seminar%20-%20GBER.pdf?version=1&amp;modificationDate=1405083969000&amp;api=v2"><em>The General Block Exemption Regulation 2014–2020 (GBER)</em></a>, JASPERS Networking Platform State aid seminar, 8 July 2014.</li><li>Simon Y., Przeor M. (2016), <a href="http://ec.europa.eu/regional_policy/sources/conferences/state-aid/rdi/ppt03-1045-1215_issues_identified_simon_przeor_rdi_27012016.pdf"><em>State aid rules for RDI. Selection of questions received from Member States</em></a>, European Commission.</li></ul><p><a href="#_ftnref1">[1]</a> See: <a href="http://s3platform.jrc.ec.europa.eu/state-aid">http://s3platform.jrc.ec.europa.eu/state-aid</a></p><p><a href="#_ftnref2">[2]</a> See: <a href="http://ec.europa.eu/competition/state_aid/legislation/block.html">http://ec.europa.eu/competition/state_aid/legislation/block.html</a></p><p><a href="#_ftnref3">[3]</a> See: <a href="http://ec.europa.eu/regional_policy/en/policy/how/improving-investment/state-aid/">http://ec.europa.eu/regional_policy/en/policy/how/improving-investment/state-aid/</a></p><p><a href="#_ftnref4">[4]</a> See: <a href="http://ec.europa.eu/competition/state_aid/scoreboard/index_en.html">http://ec.europa.eu/competition/state_aid/scoreboard/index_en.html</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4b9fc7197adf" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/5-4-ris3-administrative-framework-conditions-4b9fc7197adf">5.4. State aid law compliance for RIS3 implementation</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[5.5. RIS3 calls consultation]]></title>
            <link>https://medium.com/onlines3-consultation/5-5-ris3-calls-consultation-c6d2ef2279fd?source=rss----9423a192ea09---4</link>
            <guid isPermaLink="false">https://medium.com/p/c6d2ef2279fd</guid>
            <category><![CDATA[policy-mix]]></category>
            <dc:creator><![CDATA[OnlineS3 Project]]></dc:creator>
            <pubDate>Mon, 19 Dec 2016 10:51:47 GMT</pubDate>
            <atom:updated>2016-12-19T10:51:47.117Z</atom:updated>
            <content:encoded><![CDATA[<h4>The method will enable RIS3 stakeholders to assess calls for projects under SF operational programmes that are made by regional authorities.</h4><h3>Background and rationale</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/1*kdpBXfh8zRtitU1eIBS0hA.png" /></figure><p>The aim of this method is to allow stakeholder input during the ‘Calls for Projects’ process. This would allow stakeholders to propose specific selection criteria and feedback during the overall process. This method could be considered to be part of a wider open consultation framework, adopted by the EU that incorporates stakeholders’ active interaction with the regional or national authorities. As a result, such a consultative process could increase the effectiveness of the resulting RIS3 actions, by making them meet more responsively the regional policy needs and by strengthening stakeholders’ participation in the submission of projects for support. This method aims to facilitate the RIS3 Action Plan implementation, in terms of preparing and assessing Calls for Projects.</p><h3>Description of the method</h3><p>In general, the term ‘stakeholder consultation’ refers to the interaction with stakeholders during processes of evaluation or preparation of policy initiatives, as well as implementation of existing interventions. In this case, we choose to focus on stakeholders’ participation throughout the Call for Projects process.</p><p>This method offers stakeholders the ability to interact with the Call for Projects, during the preparation stage, proposing evaluation criteria that could be included. Its additional value rises especially in the cases of projects related to highly specialized areas that might require increased scientific or technical knowledge, in order to prepare the selection criteria for the projects. For example, if the Call for Projects addresses a very specific topic such as: “The effect of climate change on Arctic permafrost and its socio-economic impact, with a focus on coastal areas” (<a href="http://ec.europa.eu/research/participants/portal/desktop/en/opportunities/h2020/topics/bg-11-2017.html">http://ec.europa.eu/research/participants/portal/desktop/en/opportunities/h2020/topics/bg-11-2017.html</a>), then it would be much easier for regional authorities, which might not have the appropriate knowledge base for this topic, to interact with certain specialized stakeholders for preparing the selection criteria for the projects.</p><p>Throughout a consultation strategy design process, there are 4 key stages including: 1) the objective setting; 2) the stakeholders’ definition; 3) the selection of the methods and the tools; and 4) the consultation data management system (EC, 2015). Given the fact that the first stage referring to the objectives’ setting has been already set in the phase of Call preparation, during a previous Phase in the RIS3 strategic planning process, the other three stages should be implemented within this method.</p><p>Focusing on stage 3, the most appropriate consultation methods and tools depend on the objectives of the consultation, the identified stakeholders, the nature of the initiative as well as required time and resources. There is a large number of methods that could be used, corresponding to a variety of stakeholder consultation tools. These might include: open public online consultation, open public online consultation — consultation website template, surveys, Eurobarometer surveys, stakeholder conferences / public hearings / events, stakeholder meetings/workshops/seminars, focus groups, interviews, Commission expert groups/similar entities, SME panels, consultations of local/regional authorities (networks of the Committee of the Regions), questionnaires, online discussion fora/interactive online tools.</p><p>The purpose of the stakeholder consultation process covers three main domains: i) informing; ii) seeking views; and iii) participation and partnership. The selection of the appropriate consultation tool should be based first on the type of Call, and second on the extent to which regional authorities would like stakeholders’ participation to be embedded within the process of Call preparation. The selected method could be implemented as an online tool to manage and assess RIS3 project proposals. Through this tool those managing the Calls for projects and the stakeholders participating in the process would be able to communicate and interact with each other.</p><h3>Usability and impact</h3><p>By implementing the Calls-for-Projects consultation method, it will be possible for regions and stakeholders to better communicate with each other regarding what they expect from the RIS3 actions. Promoting a constructive dialogue between them, the Call-for-Projects process could be properly designed in order to properly specify the criteria for project selection, so that they are best fitted to both sides: those that call for projects and those that take part in them. This would positively impact on the effectiveness and ease of implementing RIS3, by facilitating regions to call for projects that best fit their priority setting that has resulted from shared vision and strategy formulation under the RIS3 framework.</p><h3>Required data</h3><p>For implementing this method, information regarding the priority setting from Phase 4, as well as the shared vision and the strategy formulation, coming from Phase 3, is required. Moreover, information regarding the calls for projects is also needed, in the form of draft texts, so that participating stakeholders can have a solid basis upon which they can share their proposals and thoughts.</p><h3>Relevant data sources</h3><p>All data will be produced by the participants during the consultation process. Additional data that would be useful would include similar actions implemented in other EU regions, and assessments of actions which might inform stakeholders about the impact and challenges of similar actions in other regions. The following section provides a practical example for implementing the Calls consultation method in the field, using stakeholder meeting as the main implementation tool.</p><p><strong>A practical example from the Region X</strong></p><p>A technical meeting for the finalisation of the 1st call of proposals on innovation, research and development for enterprises, OP of the Region X, 2014–2020, took place in the summer of 2016. In the technical meeting more than 50 representatives from companies, university and research labs, and the public administration were invited. It was organised by the Special Managing Service of the Regional Operational Programme of Region X and concerned the discussion and feedback on the forthcoming call of the ROP «Investment Plans for Research, Innovation and Business Development», Investment Priority 1b.1.1.</p><p>Following a welcome by the chair of the Regional Research and Innovation Council and reference to the RIS3 by the Special Managing Service, the technical meeting took place in three sessions:</p><p>a) Presentation of the main features of the forthcoming call, which was targeted at the chemical and polymer materials industries, and the criteria for the assessment and selection of investment projects.</p><p>b) Comments by representatives of the DG Regio G5.</p><p>c) Comments and suggestions on the call by participants in the meeting.</p><p>In the first session, a presentation of the forthcoming call was made. The Call was 60 pages of text describing:</p><p>1. The legislative — regulatory framework for implementation of action<br>2. The identity of action<br>3. Bodies implementation of action<br>4. Eligible activities<br>5. Eligible expenditure — budget operations<br>a. Eligible expenditure<br>b. Budget projects — implementation period<br>6. Financing scheme<br>7. Procedure and receiving funding request<br>8. Documents and information for the assessment of funding applications<br>9. Criteria &amp; process assessment — approval of operations<br>a. Bodies assessment funding applications<br>b. Evaluation process — evaluation criteria<br>c. Appeals process<br>d. Approval of operations<br>10. Procedure implementation — monitoring of operations<br>a. Settlement costs of implementation<br>b. Monitoring acts; checks — certificates<br>c. Payment of aid<br>11. Procedure changes<br>12. Completion of operations<br>13. Beneficiaries obligations and review compliance<br>a. Test compliance obligations of beneficiaries<br>b. Sanctions.</p><p>During the second session of the meeting, the comments by representatives of DG Regio focused on the need (1) to make an explicit reference to the RIS3 Action Plan and the RIS3 action to be implemented through this call, (2) to make clear the connection of the call and the EDP workshop on Chemicals and Polymers that was held earlier in the Region X, (3) to specify segments of the chemical, rubber and plastics industries should have priority, (4) to define the precise meaning of “applied research and development”, “experimental development” and “innovation” given the different levels of co-funding in these categories, (5) to assess the contribution of proposals to output indicators and regional innovation performance indicators, (6) limit the funding on building and premises below the foreseen 35%, and (7) use more output and result indicators (four and one only) to assess the impact of the call.</p><p>In the third session, the discussion with the participants, mainly those coming from the industry, was detailed and covered most of the meeting. It focused on the following subjects:</p><p><em>1. Industries to be supported</em>: The use of NACE codes (20-Manufacture of chemicals and chemical products, and 22-Manufacture of rubber products and plastics) to define enterprises eligible for support was received very well, especially for its clarity. Additionally, it was asked (1) including industries that produce polymer products falling in other than 20 and 22 groups (e.g. 13.9 Manufacture of other textiles), (2) defining whether the group codes refer to industrial permissions or categories of financial activity, and (3) defining the time limit that a company may register additional activity codes (e.g. till the opening of the call / file submission/ 31–12–2014/ other).</p><p>On the contrary, the reference to the value chain (justify the contribution of proposals to the value chain of chemicals and polymer materials) was seen as unclear and imprecise. While in Annex 4, detailed information is provided on 3- and 4-digit eligible manufacturing activities, the use of the value chain does not clarify whether a proposed investment project would be eligible. Moreover, it was observed that references to value chains makes the use of NACE groups unnecessary, since a value chain may comprise many industry groups, from agriculture, to utilities, and retail.</p><p><em>2. Conditions and intensity of support: </em>The conditions for support, from the state-aid regime point of view were discussed, in particular those concerning non-eligible enterprises, faulting enterprises, bankrupt enterprises, obligation of location premises not headquarters in the Region X, etc.; those concerning the spending period; and the minimum funding support. Also the different rates of funding were discussed per type of research and size of company.</p><p>The demarcation lines between “industrial / applied research”, “experimental development” and “innovation” were seen as unclear, especially the justification of new vs. existing knowledge and skills for product development / improvement (innovation). There is a need for very experienced assessors to judge the industrial limits between applied research and experimental development.</p><p>The purpose of including feasibility studies in the investment plan was clarified, as studies concerning the valorization / exploitation of the R&amp;D than feasibility studies for the proposed research and innovation. In addition, the meaning of open science criteria was explained, as using them may increase the level of funding.</p><p><em>3. Eligible categories of funding and ceiling per category: </em>The table of funding categories and max funding per category was extensively discussed. It was admitted that (1) a minimum ceiling to personnel spending should be defined, e.g. 25% of total cost, which guaranties that the produced research and skills will remain in the beneficiary enterprise; (2) spending for buildings and premises should concern only internal refurbishment related to research and pilot units and co-funding rate should be lower; and (3) spending for subcontracting and purchase of technology should not lead to “buy” rather than “produce” research and innovation.</p><p><em>4. Assessment process and criteria:</em><strong> </strong>The four stages of assessment were presented. The inclusion in the assessment criteria of (a) orientations from the EDP workshop realised earlier in the Region, and (b) criteria related to innovativeness of proposed investments, contribution to regional innovation performance, and generation of knowledge-intensive employment was discussed.</p><p>Assessment criteria related to employment creation are included in Stage B; and might also be part of Stage C, as generation of knowledge-intensive employment. Criteria related to targeting new market opportunities are included in Stage C; might also be related to EDP workshop conclusions. For successful projects, the assessment should be extended at the implementation period, which would enable corrective actions before the end of the project and the period of eligible expenses.</p><p><em>5. Required documents for the assessment of funding applications: </em>Fourteen justification documents were requested to be submitted, together with the application form. Clarifications related to these documents was an important part of the meeting,. It was asked that these documents would be simplifed and reduced as much as possible at the submission stage. A more complete justification should then be required at a later stage from those enterprises positively assessed for funding.</p><p>Overall, the technical meeting was a fruitful and informative meeting. The need for a second round of EDP, focusing on the calls for investment and support, was fully justified. The Special Managing Service of the ROP invited the participating companies and research labs to send additional material and comments before the finalisation of the call to be expected by September 2016.</p><h3>Implementation roadmap</h3><p><em>Step 1: Selection of stakeholders to be invited</em></p><p>Starting from the stakeholders’ mapping, this part targets to identify the basic categories of stakeholders, based on their level of interest and influence on the specific Call. According to the Better Regulation “Toolbox”, there are six steps/questions for stakeholder identification:</p><ol><li>Who is directly impacted?</li><li>Who is indirectly impacted?</li><li>Who is potentially impacted?</li><li>Whose help is needed to make it work?</li><li>Who thinks they know about the subject?</li><li>Who will show an interest in the subject?</li></ol><p><em>Step 2: Selection of consultation mode</em></p><p><em>Method:</em> Regarding the consultation method, a choice should be made on whether it is going to be open to the public or targeted. Although open public consultations can foster transparency and accountability, and ensure the broadest public validation and support for an initiative, targeted consultation might better fit the concept of calls for projects, as it allows more focused interactions or dialogue and may tap expertise more efficiently, in particular when dealing with a very specific or technical subject.</p><p><em>Tool:</em> the choice of the appropriate consultation tools should take into consideration some basic principles, including: proportionality, the degree of interactivity needed, accessibility and time restrictions. In practice, a hybrid tool including physical presence and online platforms could be a very good solution for implementing this method.</p><p><em>Step 3: Definition of call assessment criteria under the RIS3 framework</em></p><p>An assessment grid for evaluating the consistency between the proposed Call of projects and the RIS3 framework is presents in the following table. It is important to align the assessment process of submitted projects under the RIS3 framework, as projects tending to illustrate a higher level of RIS3-orientation will be more easily implemented within the RIS3 framework, showing at the same time higher levels of efficiency.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/904/1*dDsIdLNB8zrFolWQlxajxw.png" /><figcaption>Table 1 Assessment grid of consistency between RIS3 and a Call of action</figcaption></figure><p><em>Step 5: Analysis of stakeholders’ views and reporting to the Call authority</em></p><p>The analysis of the stakeholders’ views should include a series of statistical data, coming from the stakeholders’ input. These data should give an overall picture regarding the attitude of the stakeholders towards the selection criteria of the call. Moreover, additional input including new selection criteria should be seriously taken into account, especially in cases where the call refers to projects requiring a high level of scientific background knowledge.</p><h3>References</h3><p>· European Commission (2015). Better Regulation “Toolbox”. Available at <a href="http://ec.europa.eu/smart-regulation/guidelines/docs/br_toolbox_en.pdf">http://ec.europa.eu/smart-regulation/guidelines/docs/br_toolbox_en.pdf</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c6d2ef2279fd" width="1" height="1" alt=""><hr><p><a href="https://medium.com/onlines3-consultation/5-5-ris3-calls-consultation-c6d2ef2279fd">5.5. RIS3 calls consultation</a> was originally published in <a href="https://medium.com/onlines3-consultation">OnlineS3 Consultation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>