Methods of assessing functioning of organizational and economic mechanism during innovation process implementation

This paper proposes methods of assessing the efficiency of organizational and economic mechanism of an industrial enterprise when implementing innovation processes. These methods allow continuous monitoring at all stages of innovation process implementation, lead to reduction in costs of innovation activity and enable maximum use of the creative potential of enterprise personnel. The significance and attractiveness of this method is ensured by the fact that it can be applied by industrial companies in any market fields regardless of the lifecycle stage applicable to the studied goods, company and/or innovative process because the composition and the number of specific indicators can be adjusted by the work group both before the study and in the course of the company’s innovative activities (at any stage of their implementation). The multi-sided approach proposed for assessing the efficiency of organizational and economic mechanism of the industrial enterprise when implementing innovation processes ensures full and accurate assessment of the impact of certain factors on the final result.


Introduction
In the literature on economics, assessment of functioning of any mechanisms, as a rule, is performed by using the indicators which compare the results of certain activities with input required for their performance, i.e. efficiency [1].Thus, increased efficiency shall mean better results at reduced or equal input [2].However, a number of scientific publications express the opinion that when giving assessment, both efficiency and effectiveness should be considered.Thus, for example, in the commonly known work of Mescon, Albert and Khedouri, effectiveness means the capability to "do the right thing", whereas efficiency means "doing the things right" [3].In terms of assessment of efficiency in implementation of innovation processes, this approach is of special interest, in our opinion.Indeed, when producing a certain innovation (in the form of a new product, technology, management or organization method, etc.), which is a result of innovative process, it is extremely important not only to obtain the innovation with minimum costs but to make the innovation in demand, i.e., it must correspond to certain needs both of the company that initiated its implementation and the market in which the company operates.

Methods of assessing the efficiency of organizational and economic mechanism
In addition to the characteristics of innovation process implementation in terms of effectiveness and economic efficiency, the management efficiency should be assessed taking into account another important factortime [4], i.e., the period of time required to achieve the set goal.If the innovative activities performed are both in demand to the required extent, and economically efficient to the sufficient extent, but the overall process for obtaining these innovations is longer compared with the average duration of innovative processes at similar companies, it is obvious that the efficiency of functioning of organizational and economic mechanisms for implementation of innovation processes at this company or enterprise will be lower that at the companies which achieve similar results within a shorter timeframe [5].
Thus, assessment of functioning of organizational and economic mechanisms (OEM) in implementation of innovation processes shall be performed using the following three key criteria: -Effectiveness, i.e., capability to produce innovations which contribute to the achievement of set goals as a result of innovation processes; -Economic efficiency, i.e., capability to obtain necessary innovations at the allowed level of expenses; -Time or capability to achieve the required results over a certain period of time.
We propose that the functioning of organizational and economic mechanism should be assessed in three stages: 1. Assess the effectiveness of the innovation process implemented by the company; 2. Assess the practical application of methodological principles of organizational and economic mechanism for implementation of innovation processes; 3. Assess the effects of innovative activities on the basis of integrated indicators obtained at the first and second stages.\Specific features of information Additionally, it should be noted that indicators for assessment of OEM functioning were selected considering the following specific features of information: Objectivity and controllability.Indicators with values comparable with the values for prior periods should be used.The number of cases where the indicators are redetermined over time should be minimized.The method for collection and processing of input data should provide for the possibility to check the accuracy of obtained data in the course of independent monitoring.
Adequacy of reflection of ongoing changes.The indicators shall form a reliable base for assessment of innovation effectiveness.The data must be sufficiently accurate for the purpose of its use and should be obtained on a regular basis (i.e., at strictly defined intervals) and in due time.
Economic efficiency.Capability to obtain necessary data without exceeding the economically feasible cost limits.The indicator should be based on the already available information.
Conformance to the set goal (relevance).Each individual indicator must be aimed at measurement of progress in resolution of a certain task.
Accuracy and unambiguity.The indicators should be selected considering the need to continuously accumulate data and ensure their comparability over certain time periods.The essence of the indicator must be clear to the members of the work group performing the calculations and to the department managers.
Aspects of effectiveness of the innovation process.
In our opinion, effectiveness of the innovation process should be assessed in three aspects: organizational and management, social and production [6].
1.Organizational and management effectiveness reflects the degree of optimization of production system hierarchical pattern, level of correlation between coordination and subordination ties in it, possibilities for implementation of organizational potential and achieving maximum output from management actions.The integrated indicator which determines the organizational effectiveness of the innovative process is represented by Ɉ5 HTQ ZKHUH ɌGHS coefficient of profitable departments; ɌVP structuredness of management personnel; ɌP manageability of management personnel.Coefficient of profitable departments, i.e., those directly involved in the product lifecycle and making considerable contribution to the economic result achieved by the company, eqn.(2): ZKHUH ɄGHSDUWPHQW number of profitable departments; Da actual number of departments.Structuredness of management personnel, eqn.(3): where Dr regulatory number of structural divisions; Hr regulatory headcount of management personnel; Ha actual headcount of management personnel.Manageability of management personnel, eqn.( 4): where i=1, …, Z -number of management levels; ɇDL DQG ɇUL -actual and regulatory number of employees assigned to one manager at the ith management level on the average.
2. Social effectiveness of the innovative process reflects the consumer and social significance for the society and certain individuals observed in the course of consumption of newly created or improved material products.The integrated value which determines the social effectiveness of the innovative process is represented by (SR), eqn.(5): where Cquality quality coefficient (determined based on department indicators); Cecology coefficient of environmental safety of production activity (determined based on department indicators) [7].
3. Production effectiveness reflects the increase in the level of production and technological activities of the company and quality of work performed by its employees.The integrated indicator which determines the production effectiveness of the innovative process is UHSUHVHQWHG E\ Ɋ5 HTQ where Qaut -number of workers performing technological operations using machines and by supervision of automated machinery, people; Q -number of workers participating in technological processes, people.
Level of technological progress, eqn.( 8): where Qtech.prog-number of new and improved technological processes, pc.; Q tech -total number of technological processes in accordance with technological documentation of the company, pc.
Losses due to defects to the volume of issued product, eqn.(10): ZKHUH ɋ GHIHFW -losses from defects for the period, RUB.
Rhythmicity of production -the actual volume of goods issued in the first ten days period, RUB/hours.
The proposed system of integrated indicators reflects the effectiveness of innovation implementation and its application will contribute to the selection of further organizational modifications associated with this innovation and development of innovative management strategy at large.
After establishment of multi-aspect system of indicators for direct assessment of innovative process effectiveness, we propose that the graphic method should be used.Indices of integrated indicators are marked on the axes (study periods are the same -month, quarter, half year) to reflect the organizational and management, social and production effectiveness of the innovative process; further, the center of gravity of the triangle is identified to reflect the integrated result of studied innovative process and demonstrate graphically which indicators reacted in the greatest degree.Then, assessment of innovative process effectiveness focuses on tracking the dynamics of movement of this active point and analysis of its new position.Thus, the developed methods for assessment of innovation implementation effectiveness enable establishing the parameters for innovation modification and contribute to selection of further organizational modifications associated both with this innovation and with development of innovative management strategy at large; the methods can be applied both in the course of innovation implementation at any stage as the basis control element and for assessment of the final effectiveness of the innovative process.
Therefore, the following integrated indicators are proposed for use in assessment (see the Figure 1) [8].

3
The practical application of methodological principles of organizational and economic mechanism Further, let us assess in more detail the practical application of methodological principles of organizational and economic mechanism of innovation process implementation at companies.The indicators reflecting the application of methodological principles of organizational and economic mechanism in the business practice in the course of implementation of innovations with various degree of complexity must conform to the requirements which we make to ensure the accuracy of assessment of modifications in conditions institutionalizing the innovative process implemented at the company and stimulating the development of the innovative activities in the company at large.Namely: 1. Express the essence of organizational and economic mechanism for implementation of the innovative process and give qualitative and quantitative assessment of its functioning; 2. Have complex nature as required to obtain multiaspect characteristics of conditions impacting the institutionalizing of innovations at companies; 3. Ensure accuracy, completeness and timely manner of information obtaining to ensure flexible and adaptive management of innovative activities at large. 1.Take into account the possibility to change the conditions and tasks associated with development of the innovative activities at the company.
Thus, the overall assessment of functioning of organizational and economic mechanism will be performed as follows, eqn.(11): where ɍ' ɍ% ɍ$ -level of dynamics in management of organizational modifications, level of reduction of social and organizational resistance, level of creative potential activation respectively;

Indicators for assessment of organizational and economic mechanism
ZKHUH ɌGXUDW -time for experiment and time for implementation (the ratio tends to minimum); ɌTXDOLI -number of cases where the employee's qualification corresponds to the work performed by the employee (the ratio tends to 100.0 %); ɌFORVHG -number of vacancies closed as required for implementation of innovative process (the ratio tends to 100.0 %); ɌFRP -the indicator in inter-structural communications (the ratio tends to 100.0 %); ɌSURJUHVV -number of new technologies and methods of organization and management (the ratio tends to maximum).
The indicator of inter-structural communications shall be calculated as follows, eqn.( 14): ZKHUH ɄFRP GHS -number of departments that exchange data in regulated and automated manner; ɄGHS -total number of departments in the company.The level of reduction of social and organizational resistance shall be determined as follows, eqn.( 15 ZKHUH ɌGHEW -level of current debt owed to the employees in the form of salary (the ratio tends to 1); ɌLQI -level of communication automation (the ratio tends to maximum); ɌLQIR -indicator reflecting the sources and quality of information available for the employees engaged in the innovative process, falls within the interval (0;1), tends to 1; ɌGHFHQW -indicator reflecting the engagement of personnel into the innovative process (the ratio tends to 100.0 %); ɌSHUI -performance of the employees engaged into implementation of the innovative process, reflects the quality of work performed, falls within the interval (0;1), tends to 1; ɌVRF -indicator reflecting social tension (the ratio tends to the minimum).
The level of current debt owed to the employees in the form of salary, eqn.( 16): where APSaccr -employees' salary accrued for payment (minus income tax and contributions to nonbudgetary funds out of salary), RUB.
APSpaid -actually paid salary, RUB.Level of communication automation, eqn.(17): ZKHUH ɆD ɆU -actual and regulatory number of PCs used for making management resolutions in the course of innovative process implementation, pc.; ɄLQI D number of information technologies used for making management resolutions in the course of innovative process implementation, pc.; ɄLQI U number of information technologies required for making management resolutions in the course of innovative process implementation, pc.
Indicator of personnel involvement into the innovative process, eqn.(18): ZKHUH &D ɋU actual and regulated number of employees engaged into the innovative process, people.
Indicator of social tension, eqn.(19): where Qconf -number of conflicts under review in the company departments and at administrative bodies, pc.; Q -total number of employees, people.Level of creative potential activation shall be determined as follows, eqn.
ZKHUH ɌSDWHQW -number of registered rights to intellectual property, pc.(the ratio tends to maximum); ɌFUHDW -indicator of personnel's creative activity, to be determined based on the number of innovative proposals from employees involved into the innovative process, pc.(the ratio tends to maximum); ɌSURI -indicator reflecting the level of professional training and qualification of employees, to be determined on the basis of attestation, falls within the range (0;1), tends to 1; ɌWXUQRYHU -turnover of personnel (the ratio tends to minimum).
Indicator of personnel turnover, eqn.(21): where Qdismiss -number of employees who left voluntarily or were dismissed for violation of workplace discipline, people; Q -total number of employees, people.
To assess the effects of innovative activities in the aspect of implemented innovative process, first of all, we need to identify the effects which reflect the comparison of results of innovative process implementation management with the costs associated with this management.The majority of Russian and foreign authors refer to the list specified in Table 1 [9]: However, it is difficult to identify the exact impact of implemented innovative processes on all the above indicators because in this assessment, the innovative activities of the company should be reviewed as the only events and activities performed by the company, i.e., the current functioning of the company and multiple factors which have impact on it should be disregarded.

Conclusion
Thus, integration of results achieved directly through implementation of the innovative process and functioning of OEM enables identification of the key effects.In the aspect of organizational and management effectiveness -effect of reduced time for innovative process implementation.In terms of social effectiveness -effect of competitive advantages of produced product.Production effectiveness shall be interpreted as the effect of increased workforce productivity, reduced losses due to defects, reduced expenses on warranty services.
The, the final economic effect of implementation of a specific innovative process and OEM functioning shall be calculated using the following equation, eqn.( 22): , (22) where Ecompet.-increase of revenues from sale of company products due to increased demand as compared with sales before implementation of innovative process or analogs existing in the market (including new contracts); Eloss to defect economic effect of reduced losses caused by defects (including returns by buyers); Ereduc.timesavings achieved due to reduced time for implementation of innovative process (measured based on notional value of 1 standard hour); Ewarranty savings achieved due to reduced expenses on warranty services (based on reduction in the number of claims); Eperformance effect of increased volume of goods over the reviewed period.
Due to timely calculations of indicators of final efficiency, reserves can be identified and strategy of their use can be developed based on concretization of objectives and, finally, a highly efficient mechanism for implementation of scientific and technical achievements can be created in the framework of an industrial company.
Thus, practical application of this method will contribute to production of products which conform to the consumer expectations while minimizing one-time and continued costs for implementation of innovative processes and ensure company profit growth due to increased share and segments of consumers.

Fig. 1 .
Fig. 1.Integrated Indicators of OEM for Innovative Process Implementation.

Table 3 .
Comparison of the three machine-building enterprises activity results on criterion of functional and resource integrity.