Recomendados
Más contenido relacionado
Similar a StarBase Dynamics AX Quality Survey March 2016
Similar a StarBase Dynamics AX Quality Survey March 2016 (20)
Último
Último (20)
StarBase Dynamics AX Quality Survey March 2016
- 2. © StarBase Computer Services 2016 2 www.starbase.co.uk sales@starbase.co.uk Tel: +44 (0)20 8236 7010 Overview/Ra<onale Dynamics AX is being used for increasingly larger programmes. OrganisaOons need to see return on the investment they’ve made in AX. CriOcal to this is being able to deliver AX programmes with the right level of quality. This survey is an aSempt to understand quality from the perspecOve of those charged with delivering these programmes. Objec<ves • Document the challenges and pain points faced by people delivering major AX programmes • Feed back informaOon for AX Programme Managers to contextualise their situaOons Who we have surveyed • AX Programme Directors and Managers running larger implementaOons • Respondents represent a cross-secOon of the AX universe, predominantly in the UK StarBase AX Quality Survey Key Findings • AX is not straigh^orward to implement: Programme Managers are facing a large set of obstacles to delivering quality into their programmes • The tesOng that AX needs is underesOmated: PMs cannot find the skilled personnel, Ome and budget for tesOng, and this is pu`ng their programmes at risk • The complexity of the larger programmes – integraOons, customisaOon, environments – creates many more points of risk • System performance – both speed of response and ability to scale – is a major concern for the PMs of larger programmes • Programme Managers are for the most part relying on non-specialist tesOng resources to deliver quality assurance
- 3. © StarBase Computer Services 2016 3 www.starbase.co.uk sales@starbase.co.uk Tel: +44 (0)20 8236 7010 StarBase AX Quality Survey 0 - 150 150 - 250 250 - 500 500 - 1000 > 1000 Less than £1m £1m to £2m £2m to £5m Over £5m Over £10m Profile of Survey Respondents Agriculture Engineering Services FaciliOes Management Food & Beverage Manufacturing Media Other Public Sector Retail By number of users By budget spend By sector AX7 AX2012 R3 AX2012 R2 AX2012 R1 AX2009 By version
- 4. © StarBase Computer Services 2016 4 www.starbase.co.uk sales@starbase.co.uk Tel: +44 (0)20 8236 7010 0% 20% 40% 60% 80% 100% Tracking and managing the quanOty of defects Securing sufficient budget for quality Visibility of QA acOviOes Proving scalability to the required number of users Having a clear and well-designed QA process Managing environments Speed of system response Ensuring that integraOons with other systems work Timescales available for test The quality of the tesOng being performed Availability of suitably skilled people 5 4 3 2 1 AX Programme managers report not having access to the specialists, <me or budget needed to solve the quality challenges that AX presents StarBase AX Quality Survey Not an issue What are the most challenging aspects in achieving quality in your project? Threatens project success
- 5. © StarBase Computer Services 2016 5 www.starbase.co.uk sales@starbase.co.uk Tel: +44 (0)20 8236 7010 0% 20% 40% 60% 80% 100% Tracking and managing the quanOty of defects Securing sufficient budget for quality Visibility of QA acOviOes Proving scalability to the required number of users Having a clear and well-designed QA process Managing environments Speed of system response Ensuring that integraOons with other systems work Timescales available for test The quality of the tesOng being performed Availability of suitably skilled people 5 4 3 2 1 The inability to find sufficient skilled people is perceived as being the largest threat to achieving programme quality StarBase AX Quality Survey 80% of all projects and 100% of large projects surveyed scored this a 4 or 5 Not an issue Threatens project success
- 6. © StarBase Computer Services 2016 6 www.starbase.co.uk sales@starbase.co.uk Tel: +44 (0)20 8236 7010 0.0% 20.0% 40.0% 60.0% 80.0% 100.0% Up to £5m Over £5m Over £10m Extensive Moderate Some LiSle to None StarBase AX Quality Survey 0% 20% 40% 60% 80% 100% None LiSle Fair Extensive Degree of customisation – all programmes “It has been proven many many times that too much development makes ERPs unstable and slow” – Programme Manager on a multinational AX implementation The larger programmes, which all have more customisa<on and complexity, generate a common set of challenges for their PMs Customisation by programme size Top concerns of large programmes • All PMs on programmes of 500 users or over cited lack of personnel skilled in QA as being their greatest concern • 85% cited system responsiveness as a major threat to programme success • 70% were concerned about their ability to prove that their system would scale as needed • 56% said that integraOons with other systems were potenOally criOcal sources of failure 56% correlation between user numbers, budget and customisation
- 7. © StarBase Computer Services 2016 7 www.starbase.co.uk sales@starbase.co.uk Tel: +44 (0)20 8236 7010 StarBase AX Quality Survey Programme Managers on larger AX programmes are looking outside their organisa<ons for tes<ng capability AX Partner Internal Test Team External TesOng Company Who will provide your tes6ng? Larger programmes All programmes • While most smaller programmes intend to use their own teams to test, the majority of the larger programmes are looking outside their organisaOons for tesOng capability. That is consistent with lack of suitably skilled people being their greatest concern • Respondents were then split on who should provide their tesOng: 37% said that their AX partners would provide all their tesOng. Others insisted that there is a set of tesOng acOviOes that their organisaOon must own and undertake (User Acceptance, Performance, Security and Disaster Recovery were menOoned)
- 8. © StarBase Computer Services 2016 8 www.starbase.co.uk sales@starbase.co.uk Tel: +44 (0)20 8236 7010 StarBase AX Quality Survey On larger AX programmes, where scalability is an priority, there are concerns as to how to test for it We expect AX to scale so won’t test this We are tesOng scalability as part of the programme • For those who will test scalability, roughly equal proporOons are planning to do so using their internal team, using an external specialist and relying on their AX Partner • All but one of the PMs subsequently spoken with said that scalability tesOng is not a service that their AX Partner can deliver 68%32% “We need to ensure that our users in the US, the UK and the Far East are ge`ng the same performance” – PM on a 20,000 user programme “In pracOce, performance tesOng is oren not done and hardware is over-specified instead” – PM on a 500 user programme
- 9. © StarBase Computer Services 2016 9 www.starbase.co.uk sales@starbase.co.uk Tel: +44 (0)20 8236 7010 StarBase AX Quality Survey 0% 20% 40% 60% 80% 100% No Yes Are you considering a cloud implementaOon of Dynamics AX? 0% 20% 40% 60% 80% 100% No Yes Is your organisaOon planning on upgrading to AX7 within the next 18 months? Nearly all the organisa<ons surveyed plan to stay with an on-premises AX2012 solu<on
- 10. © StarBase Computer Services 2016 10 www.starbase.co.uk sales@starbase.co.uk Tel: +44 (0)20 8236 7010 StarBase AX Quality Survey • While Dynamics AX is sold on ease of implementation, Programme Managers are facing a significant set of factors that are putting the quality of their programmes at serious risk. • The challenges that they are facing appear to be the same as those faced by Programme Managers in any ERP programme • However, they are compounded by a lack of experienced QA resources • Programme Managers are trying a number of approaches to meet these challenges but without confidence that all the risks can be mitigated • The practice of quality and testing around Dynamics AX is very underdeveloped, and this leaves Programme Managers and their employers exposed Conclusions “Like any other ERP implementaOon, under-esOmaOon of the Ome needed, the complexity and the requirement for skilled resources is a huge issue when you want to deliver a quality driven successful project” – PM on a 700 user AX implementa6on