As the highest ranking population for Internet adoption in North America, the Government of Bermuda recognizes the value of having a strong and sustainable online presence to serve the Island’s citizens and industries now and into the future.
The Government of Bermuda was challenged with reducing its operating costs, improving customer service, launching digital services and becoming more efficient. This was a tall order as their existing proprietary portal and many stand-alone websites were all built upon disjointed platforms and technologies, and most of their applications were not integrated. Their decision to adopt open-source Drupal fulfilled their need for a base platform upon which they could transform their business processes, while being able to provide significant value to Bermuda’s constituents and scalability.
Join this session with The Government of Bermuda and partner, OPIN Software to learn:
-How Drupal became the platform of choice over SharePoint & -Sitecore, other proprietary systems like IBM and other Open Source solutions like LifeRay
-How to implement a Drupal site in an organization with many moving pieces, and gain decision-maker buy-in
-The early successes and early challenges since the April 2016 launch
-The Government of Bermuda’s plan for launching digital services online using Drupal
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
Why the Government of Bermuda Chose to Build Their New Citizen-centric Digital Portal Using Drupal
1. Martin Walsh – Director of eGovernment, The Government of Bermuda
Chris Smith - CEO, OPIN Software
Mathieu Weber – Vice President, Canada, Acquia
Why the Government of Bermuda Chose to Build
Their New Citizen-centric Digital Portal Using Drupal
2. AGENDA
1. Introduction
– Benchmarks
– As-Is & To-Be
1. The Acquisition
– Objectives of getting a new portal
– RFP Process
– How “Open Source” won the Bid
1. The Implementation
– Project Challenges – Cost & Time
– Project Objectives Score Card
– Public Usage & Satisfaction
– Challenges & Lessons Learnt
1. Phase-2 – Digital Services
2. Under the Hood (over to Chris Smith of OPIN, Mathieu Weber of Acquia)
3. Question Time
11. 2. Acquisition
Problem Statement
PROBLEMS WITH CURRENT PLUMTREE (ORACLE) PORTAL
• Out of Date Content
• Not User-Friendly & poor search
• Unreliable
• Lack of Services
• Costly Oracle maintenance
• Never configured properly
• Many Departments left the Portal & built their own Web Sites
12. 2. Acquisition
Project Objectives
3 Strategic Customer-facing
Goals
4 Strategic Operational Goals
1: BECOMING A TRUSTED INFO SOURCE
i.e. …………BETTER CONTENT QUALITY
4: SELF MAINTAINING
i.e. …………GOOD GOVERNANCE
5: MEASURED (Analytics/Surveys)
i.e. …………GOOD METRICS TO QUANTIFY PERFORMANCE.
2: CONVENIENT & MOBILE
i.e. …………EASIER TO USE
6: BACK-END INTERFACES
i.e. …………AUTOMATED DATABASE ENTRY
3: PUBLIC/BUSINESS ENGAGEMENT
i.e. …………A 2-WAY COMMUNICATION CHANNEL
7: DIGITAL SERVICES
i.e. …BECOMING THE PLATFORM FOR PHASES 2+
13. 2. Acquisition
RFP Process
–RFP based on Global Best Practice & Bermuda Customer Insight
–Issued on schedule in June 2015
–13 Responses received (see graphs below),
• 8 TRADITIONAL; 5 OPEN-SOURCE/CLOUD
• reduced to 10 for initial presentation,
• then 3 for final presentation,
• then 2 for BAFO (Best and Final Offer rebid)
14. 2. Acquisition
How “Open Source” won the Bid Process
CHOICES FOR
DIGITIZATION
Own Functional
Flexibility
Cost R t W Speed to
Market
Support
Staff
Technical
Flexibility
BUILD
BUY
SUBSCRIBE
OPEN-SOURCE
= strong advantage = advantage = pros & cons = weakness
15. CHOICES FOR
DIGITIZATION
Own Functional
Flexibility
Cost R t W Speed to
Market
Support
Staff
Technical
Flexibility
BUILD
BUY
SUBSCRIBE
OPEN-SOURCE
= strong advantage = advantage = pros & cons = weakness
2. Acquisition
How “Open Source” won the Bid Process
16. CHOICES FOR
DIGITIZATION
Own Functional
Flexibility
Cost R t W Speed to
Market
Support
Staff
Technical
Flexibility
BUILD
BUY
SUBSCRIBE AC QU IA
OPEN-SOURCE O P I N
= strong advantage = advantage = pros & cons = weakness
R t W = Reinvent the Wheel
2. Acquisition
How “Open Source” won the Bid Process
17. 2. Acquisition
Why OPIN & ACQUIA?
• OPIN HAD MANY CANADIAN GOVERNMENT CLIENTS
e.g. Premiers Office, Transport etc., who all gave excellent references.
• DRUPAL – EXTENSIVE LIBRARY OF ROUTINES via “COMMUNITIES OF INTEREST”
e.g. Canadian Government Tool-Kit, & in the future Australia’s Govt. COI…
• OPIN HAD IMPRESSIVE STAFF & RIGHT SIZE/INCLINATION FOR A PARTNERSHIP
18. 2. Acquisition
Why OPIN & ACQUIA?
• OPIN HAD MANY CANADIAN GOVERNMENT CLIENTS
e.g. Premiers Office, Transport etc., who all gave excellent references.
• DRUPAL – EXTENSIVE LIBRARY OF ROUTINES via “COMMUNITIES OF INTEREST e.g.
Canadian Government Tool-Kit, & in the future Australia’s Govt. COI…
• OPIN HAD IMPRESSIVE STAFF & RIGHT SIZE/INCLINATION FOR A PARTNERSHIP
• LOW COST & WITHIN OUR BUDGET
• BIGGEST AREA WHERE LOST TO SITECORE WAS “OUT OF THE BOX” ANALYTICS
• ACQUIA CAME LATER AT OPIN’s SUGGESTION
–Already proposed as partner to another of the 13 bids
–Scored high in evaluation, but ruled out when US only hosting option
19. 3. IMPLEMENTATION
PROJECT CHALLENGE - COST
BUDGET:
•MULTI-YEAR PROJECT – CAPITAL BUDGET……..$1.9M
• Anticipated cost of system …………………………….$1M
•CAPITAL BUDGET FOR 2015/16 only……………...$500k
•CANCELLING ORACLE SUPPORT SAVINGS ………$230k
20. 3. IMPLEMENTATION
PROJECT CHALLENGE - COST
= Traditional (Sitecore)
= Open-Source (Drupal)
$1.15M Current 5yr cost
BUDGET:
•MULTI-YEAR PROJECT – CAPITAL BUDGET……..$1.9M
• Anticipated cost of system …………………………….$1M
•CAPITAL BUDGET FOR 2015/16 only……………...$500k
•CANCELLING ORACLE SUPPORT SAVINGS ………$230k
21. 3. IMPLEMENTATION
PROJECT CHALLENGE - COST
DRUPAL
SOLUTION
ACTUAL
SPEND
% ANNUAL
COST
REQS, RFP,
DESIGN
170k 26% -
PORTAL BUILD/
MAINTENANCE
170k 26% 44k
PORTAL HOSTING 10k 2% 42k
PORTAL CONTENT 200k 31% -
DIGITAL SERVICES 40k 5% tbd
OTHER COSTS 70k 10%
TOTAL $660k $86k
= Traditional (Sitecore)
= Open-Source (Drupal)
$1.15M Current 5yr cost
BUDGET:
•MULTI-YEAR PROJECT – CAPITAL BUDGET……..$1.9M
• Anticipated cost of system …………………………….$1M
•CAPITAL BUDGET FOR 2015/16 only……………...$500k
•CANCELLING ORACLE SUPPORT SAVINGS ………$230k
22. 3. IMPLEMENTATION
PROJECT CHALLENGE – TIME
After issue of RFP in June 2015 & Decision in August 2015 – both on schedule!
VENDOR
CONTRACT
SIGNED
HOSTING
SET-UP
BUILD & QA
(Agile)
U.A.T. NEW PORTAL
LIVE
TARGET
DATE
OCT 2015 DEC 2015 FEB 2016 MARCH 2016 APRIL 1st
2016
ACTUAL
(5 month…………… expected originally)
(2 month……………..expected originally)
23. 3. IMPLEMENTATION
PROJECT CHALLENGE – TIME
After issue of RFP in June 2015 & Decision in August 2015 – both on schedule!
VENDOR
CONTRACT
SIGNED
HOSTING
SET-UP
BUILD & QA
(Agile)
U.A.T. NEW PORTAL
LIVE
TARGET
DATE
OCT 2015 DEC 2015 FEB 2016 MARCH 2016 APRIL 1st
2016
ACTUAL
OPIN
DEC 21st
ACQUIA
DEC 31st
OPIN/E-GOV
FEB 29th
(2 months!)
USER DEPTS
MARCH 23rd
(2 weeks!)
APRIL 1st
(5 month…………… expected originally)
(2 month……………..expected originally)
24. 3. IMPLEMENTATION
PROJECT CHALLENGE – MEETING OBJECTIVES
= met completely
= partially met
= in progress
= behind schedule
= Not met at all
PROJECT OBJECTIVES SCORE CARD – as of DEC 2016
3 Strategic Customer-facing Goals 5 Strategic Operational Goals
1: BECOMING A TRUSTED INFO SOURCE
illustrated by…………IMPROVED CONTENT QUALITY
4: SELF MAINTAINING
illustrated by. ……GOOD GOVERNANCE & CONFORMANCE
5: MEASURED (Analytics/FF/Surveys)
illustrated by……GOOD METRICS QUANTIFYING PERFORMANCE.
2: CONVENIENT & MOBILE
illustrated by… EASIER USE ON MULTIPLE DEVICES
6: BACK-END INTERFACES
illustrated by…………AUTOMATED DATABASE ENTRY
3: PUBLIC/BUSINESS ENGAGEMENT
illustrated by…………Active 2-WAY COMMUNICATION
7: DIGITAL SERVICES
illustrated by…………PLATFORM BUILT FOR PHASES 2+
PROBLEMS WITH CURRENT PLUMTREE (ORACLE) PORTAL
• Out of Date Content……………………………………………………………………….FIXED
• Not User-Friendly, poor Search, Navigation and data structure………Needs more work to increase Buy-In
• Unreliable………….. ………………………………………………………………………….FIXED
• Lack of Functionality & Services……………………………………………………..CURRENT PHASE
• Costly Oracle maintenance & technical complexity..……………………….FIXED
• Never configured properly………………………………………………………………NOT REPEATED
• Departments leaving portal………………………………….........................No Longer, but will take time to pull all
back
Expected to take at least 2-3years
26. NEXT SURVEY USAGE TARGET
NEXT SURVEY
SATISFACTION
TARGET – OCT ‘16
60%
50%
70% - April ’17
target for both
31%
3. IMPLEMENTATION
USAGE & SATISFACTION SINCE PORTAL ORIGINALLY
LAUNCHED
27. OCT ‘16 SURVEY USAGE TARGET
SATISFACTION
TARGET – OCT ‘16
60%
50%
70% - April ’17
target for both
31%
41
3. IMPLEMENTATION
UPDATE WITH OCTOBER 2016 SURVEY
RESULTS
28. 3. IMPLEMENTATION
USAGE DEMOGRAPHICS SINCE NEW PORTAL WAS LAUNCHED
•Little difference in gender demographic.
•45-54 year age group were largest users of old portal @ 50%,
•Despite rising to 68% now, have been overtaken by the young – 18-44 @ 76% usage.
OLD PORTAL Mar-16
NEW PORTAL OCT 16
29. • c. 50% of the people said their usage hadn’t changed – other 50% graphed above
• “Lower” has negative implications, but not necessarily true!
• “females” had declined markedly!
• “Over 45s” showed even bigger decline in usage– net -19%
• Evidence that the old adage is true – of “ONE SIZE DOESN’T FIT ALL”
3. IMPLEMENTATION
CHANGE IN FREQUENCY OF CLIENT USAGE SINCE NEW PORTAL LAUNCH
30. 1. NEW DESIGN NOT LIKED - 29% users
• “not u/f” or “old portal better”;
• “not by dept.” or “no depth of content“
2. STILL HARD TO FIND INFO. – 27% users
• can’t navigate or find info in less than 4 clicks
• search still not good
3. TECHNICAL ISSUES … (only 7 people – 2% users)
• Very Few Complaints
• Used to be biggest problem of prior portal
4. SATISFACTION OF 181 OTHERS
• Not Complaining on top 2 ISSUES
• Satisfaction 16% higher than average
(note: 270 of the 400 surveyed
used the portal at least once)
3. IMPLEMENTATION
IMPACT OF TOP PROBLEMS ON PUBLIC SATISFACTION
CONCLUSION: IMPROVING THE ABILITY TO FIND INFO. …..
…….& GAINING MORE ACCCEPTANCE OF DESIGN WILL SIG. IMPROVE SATISFACTION
** - Satisfaction sig higher/lower at 99% confidence level
**
**
**
**
31. 4. LESSONS LEARNT
1. IT IS POSSIBLE TO OVERCOME LIMITED RESOURCES, BUDGET AND TIME
• Utilizing OPEN SOURCE, CLOUD & AGILE
• Having Buy-in and Drive from the Very Top of Your Organization
• Having a Capable and Motivated Project Team
• Selecting the Right Vendors
………but you eventually have to “pay the piper!” (as shown by initially disappointing satisfaction)
2. TO GAIN THE MOST VALUE, TURN YOUR VENDOR INTO A PARTNER
• Look at a Vendor’s Record, Size & People, not just “Lowest Price”
• You need to be as Important to them, as They are to You
• Leverage Your New Partner’s PARTNERS!
32. 4. LESSONS LEARNT
1. IT IS POSSIBLE TO OVERCOME LIMITED RESOURCES, BUDGET AND TIME
• Utilizing OPEN SOURCE, CLOUD & AGILE
• Having the Buy-in and Drive from the Very Top of Your Organization
• Having a Capable and Motivated Project Team
• Selecting the Right Vendors
2. TO GAIN THE MOST VALUE, TURN YOUR VENDOR INTO A PARTNER
• Look at a Vendor’s Record, Size & People, not just “Lowest Price”
• You need to be as Important to them, as They are to You
• Leverage Your New Partner’s PARTNERS!
3. KEEP MOMENTUM & COMMITMENT GOING BEYOND LIVE DATE
• The most beneficial & rewarding work comes after you are live!
4. BUILD FOR THE FUTURE & “OUTCOME” MORE IMPORTANT THAN “OUTPUT”
• You’ll Be Judged On New Content & Services Not Fixing Past Problems
• Don’t Underestimate The Work to raise Public Satisfaction
5. ONE SIZE DOES NOT FIT ALL
• Don’t Underestimate Resistance to Change
• Measure, Listen, Fix/Enhance, Iterate …….Continuous Improvement
• Public Satisfaction is the True Measure of Success
33. 4. DIGITIZED SERVICES WAY
FORWARD
LIVE NOW:
•PORTAL LINKS TO ALL EXISTING O/L SERVICES FROM OTHER SYSTEMS
•TWO-WAY COMMUNICATION CHANNEL BY EMAIL
34. 4. DIGITIZED SERVICES WAY
FORWARD
LIVE NOW:
•PORTAL LINKS TO ALL EXISTING O/L SERVICES FROM OTHER SYSTEMS
•TWO-WAY COMMUNICATION CHANNEL BY EMAIL
IN-PROGRESS:
•STANDARD “COOKIE-CUTTER” SERVICES & BUSINESS PROCESSES
• Via FORM TEMPLATES & PROCEDURES (Fillable PDF to Drupal Web forms)
•STANDARD E-PAYMENT GATEWAY & O/L BANK BILL PAYMENT LINKS
•MULESOFT ESB PILOT USING RESTFUL APIs FOR BACK-END SYSTEM INTEGRATION
•STANDARD REPORTING PROCESS AND MEASURE SUCCESS (KPIs & SLAs)
35. 4. DIGITIZED SERVICES WAY
FORWARD
LIVE NOW:
•PORTAL LINKS TO ALL EXISTING O/L SERVICES FROM OTHER SYSTEMS
•TWO-WAY COMMUNICATION CHANNEL BY EMAIL
IN-PROGRESS:
•STANDARD “COOKIE-CUTTER” SERVICES & BUSINESS PROCESSES
• Via FORM TEMPLATES & PROCEDURES (Fillable PDF to Drupal Web forms)
•STANDARD E-PAYMENT GATEWAY & O/L BANK BILL PAYMENT LINKS
•MULESOFT ESB PILOT USING RESTFUL APIs FOR BACK-END SYSTEM INTEGRATION
•STANDARD REPORTING PROCESS AND MEASURE SUCCESS (KPIs & SLAs)
FUTURE:
•BECOMING CUSTOMER DRIVEN THROUGH USING INSIGHT
•ENTICING CUSTOMERS BY EXPANDING DELIVERY METHODS
……………..Use of Mobile, Kiosks, social media…etc.
•USING DRUPAL WORKFLOW TO IMPROVE INTERNAL & CUSTOMER EFFICIENCY
•SERVICE TRANSFORMATION TO LEAD TO BUSINESS TRANSFORMATION
36. 5. Under the Hood
TECHNICAL STACK
•DRUPAL 7
•APACHE SOLR
•ACQUIA CLOUD
•CORE + CONTRIBUTED MODULES.
• VERY LITTLE CUSTOM.
OPEN SOURCE
• ENABLED US TO MEET QUICK TIMELINE
• VERY COMPETITIVE PRICING: LICENSE FREE
• CONFIGURED TO MEET BERMUDA BUSINESS PROCESS
• TRAINING HAS EMPOWERED BERMUDA TEAM
• FUTURE-PROOF: NO VENDOR LOCKIN
KEY MODULES
• ACQUIA SEARCH (ENTERPRISE-GRADE APACHESOLR/MULTISEARCH/VIEWS)
• SECURITY (SECKIT, SECURE PAGES, PASSWORD POLICY, HONEYPOT)
• UX (NAVBAR, STYLEGUIDE, ADMINIMAL)
37. 5. Under the Hood
ACQUIA
•ACQUIA HELPS TO ORGANIZATIONS MAKE THE MOST OUT OF DRUPAL
•Enterprise Guide: Accountability, Governance, Security
•Drupal-tuned platform: Acquia Cloud Enterprise
•LARGEST GLOBAL NETWORK OF DRUPAL EXPERTS.
•Certifications to ensure quality of teams
•ONE OF THE FASTEST GROWING COMPANIES IN AMERICA.
•And plenty of Government Experience: Powering Australia, Los Angeles, State of New York, Boston,
ACQUIA ENTERPRISE CLOUD
•DRUPAL-TUNED PLATFORM AS A SERVICE (PaaS)
•Utility model for Drupal: Let clients & partners control the last mile
•EFFORTLESS MANAGEMENT AND RELIABILITY
•POWERFUL DEVELOPMENT TOOLS
•COMPREHENSIVE SECURITY AND COMPLIANCE
•24x7x365 SUPPORT: INFRASTRUCTURE TO THE GLASS 99.95% SLA
Highlight
lack of consistency ,
cluttered &
non u/f
Structure Designed around Services, not Departments
Standard Placement, 10 year old, all content rewritten, all pages same appearance, dynamic lists from analytics……..
Thank another partner PARTHO/Forward VU – did RFP requirements & Design
Extensive focus groups – internal, public, business
Decided on no so Spartan a look as UK/Australia
Feedback tab every page
WWW.GOV.BM – have a look, is WIP but send us feedback!
3 Customer Facing & 4 Operational
Red is deliverable or key desired outcome
Run through 1 by 1
How “OPEN-SOURCE” (OS) won the bid process
These slides helped convince non-technical executives
1st column is history of I.T. Applications & basically my I.T. career!
BUILD OWN (all did originally–Egypt & Bank of Bermuda(BOB)
Green – advantage – Ownership & Flex,
Amber - speed you control
Red – disadvantage – cost, support staff, tech flexibility
RtW – see if you can work it out
………………………………………………………………………
BUY PACKAGE – craze of 80’s & 90’s – BOB complete change
Green – Improved Speed to Market to green
Amber - Improved Cost & staff/tech to amber
- Ownership & Functional flex drop to amber though
Internet arrived, I was keen advocate, helped introduce to BOB & moved to C&W
SUBSCRIBE model emerged as alternative
Payment Gateway developed in UK, dot com bubble & need swift replacement, so resold white-labeled NY based gateway
Green – Speed to Market, Tech Flex & Support
Amber - Functional Flex & Cost
Red – Ownership
Beware long term costs eventually > “Buy” route
…………………………………………………………………Moved to Govt in 2008, Open Source wave in Govts. started
Bda Govt started their journey with portal choice in 2015
Green – 1 - 3– ownership, func flex better than build (with COI) & Cost
- No License fee is key saving
Amber - Last two same as BUY
Our RFP Winner – mixing S/W & H/W slightly in diagram!
OPIN were model 4 – OPEN SOURCE with DRUPAL
ACQUIA were model 3 for HOSTING, both all green
RtW – Reinvent the Wheel – journey from red to green
Cost not main reason, but see impact COST issue
SITECORE presentation
Very happy to switch to Acquia – see impact TIME issue
First Two were estimates
Third - Actual result of cut backs
Fourth – alternate source of funding (by separate contract)
5 year TCO for Final Two – Sitecore & OPIN
Sitecore 3x OPIN 5-year cost
OPIN even half of ORACLE support if just carry on as now
Total cost of $660k + annual commitment of $86k
$500+230 available just made it!
Cost breakdown shown FYI
WERE SET A VERY AGGRESSIVE TARGET
RFP ISSUED– June; DECISION IN August – BOTH ON SCHED
2 MONTHS TO SIGN CONTRACT; 4.5M for BUILD; 1.5M Test
APRIL LIVE DATE
ACTUAL – OFF TO BAD START
CONTRACTS IN DEC (2 months late)
RECOVERY-1: ACQUIA built site in 10 days over Xmas!
RECOVERY-2: OPIN BUILT PORTAL in 2 months,
RECOVERY-3: FV great job helping us rewrite the content
RECOVERY-4: Shorter UAT, not involve public
LIVE ON SCHEDULE IN APRIL
ON TIME, ON BUDGET BUT DID WE MEET OBJECTIVES?
PROBLEMS – 4 GREENS & 3 AMBERS
OBJECTIVES – not expect to meet all in under 2-3 years
2 PALE GREENS, - responsive site & lots of analytics
3 AMBERS, - no out of date content but WIP for depth
f/back forms/few contact forms – again WIP
SERVICES now starting on eForms
2 PINKS (behind schedule)
Governance + roll-out of responsibility
Back End interfaces – pilot of BUS pending
One example – good improvement of return visitors
Up 10% from 3 months to 6 months after live
We now monitor many different types
Because disabled on old portal to reduce crashes), no objective data for comparison
Do have extensive history of surveys giving subjective data (outcomes)
History of the life of Bermuda Portal
Usage =grey (number of people accessing portal in last 3M),
Satisfaction = blue
2008 – Usage low, satisfaction high
2011 – Usage higher, satisfaction lower!
Mar 2016 – last old portal baseline (little change in 5 yrs!)
June 2016 - New portal first survey 2 months after live
Usage flat (allowing for 2 not 3M) but Satisfaction down slightly
Not deterred – set aggressive goals for October & April ‘17
October usage breaks target & all-time 3-month record - to 66%
Satisfaction up 10% but still 9% short of target
QUICK GLANCE AT TWO DEMOGRAPHIC GRAPHS
Old portal (March ’16) v New portal (October ‘16)
Totals on left & usage up across the demographic board
Gender no difference but Young now top users, not 45-54
Surprisingly down (19% less often, only 11% more)
Could be confusing statistic
Female & over 45’s are (11-19% gap) using it less
Technical issues completely solved, only 7 complaints
77/400 complained on new design
73/400 complained about finding info
These two groups 29 & 31% below the average satisfaction score (very significant – 99% level of confidence)
The 181 complained on neither averaged 57% satisfaction
16% above average & first target & again very significant
Clear indication of what need to do, to reach 70% by April.
Read item by item
Eventually have to Pay piper, ( early satisfaction )
OPIN & ACQUIA both very good partners
OPIN led us to ACQUIA & now to MULESOFT for BUS/APIs
Giving us greater leverage & saving us money
Read item by item
Keeping Commitment after live, so hard to do
Soon forgot tech problems, now commodity- like tap water
Public Satisfaction is a hard task master!
Change always resisted!
Have to cater to multiple audiences (e.g. young & old)
Few new but WIP
Building Blocks for Future
Continuous Improvement focused on efficiency & service