MariaDB post-release quality assurance in Debian and Ubuntu
Presentation from MariaDB Server Minifest Dec 9th, 2020.
See https://mariadb.org/minifest2020/distros/
FOSDEM2021: MariaDB post-release quality assurance in Debian and UbuntuOtto Kekäläinen
Presentation slides from FOSDEM 2021.
Talk covers the MariaDB packaging in two of the most widely-used Linux distros, Debian and Ubuntu, including the strict requirements demanded by distros, and the impact on fixing bugs “upstream” in MariaDB itself.
How MariaDB packaging uses Salsa-CI to ensure smooth upgrades and avoid regre...Otto Kekäläinen
This document discusses how MariaDB in Debian uses the Salsa-CI/Gitlab-CI infrastructure to ensure smooth upgrades and avoid regressions. It describes how the MariaDB packaging repositories were moved to Salsa.Debian.org and how a custom Gitlab-CI pipeline with 18 jobs over 5 stages was created to build, test, and simulate upgrades from various versions. This comprehensive continuous integration process helps catch issues early and improve the quality and reliability of MariaDB upgrades. Challenges in testing such a large and complex package are also discussed.
This document discusses the state of MariaDB and MySQL packaging in Debian. MariaDB 10.3 is included in the latest stable Debian release, and 10.4 will be uploaded soon. MySQL 5.7 is available in unstable but not stable releases. There is ongoing work to maintain older MariaDB versions and develop new packages. Contributors are encouraged to participate in bug triage and discussions to help address stale bugs without coding skills.
This document discusses how to deploy a MariaDB Galera cluster on Ubuntu 14.04. It requires installing MariaDB, Galera, and Rsync on at least 3 Ubuntu nodes. Specific configuration files are edited to set the cluster address, node addresses, and other settings. The MySQL services are restarted and tests run to validate the cluster is functioning properly with data replicated across all nodes.
A brief introduction to MySQL (Group) Replication: what it is and some of the architecture.
Then, a highlight of the most important new replication features in MySQL 8 (as of 8.0.3 RC).
MySQL InnoDB Cluster and Group Replication - OSI 2017 BangaloreSujatha Sivakumar
The document discusses MySQL InnoDB Cluster and Group Replication. It provides an introduction and overview of InnoDB Cluster, outlining the key features and how to get an InnoDB Cluster up and running in 3 steps: deploying instances, creating a cluster, and adding more instances. It also covers setting up and starting a router. For Group Replication, it discusses the concept of replicating writes across multiple servers for high availability and read scaling. It shows how Group Replication achieves consensus on membership, message delivery and state updates across the group.
Tips to drive maria db cluster performance for nextcloudSeveralnines
200
● SSD
2000
● NVMe
4000
Tune for your hardware. Higher is better but avoid over-committing IOPS.
innodb_flush_log_at_trx_commit 1 Flush logs at each transaction commit for ACID compliance.
innodb_log_buffer_size 16M-64M Default is 8M. Increase for more transactions per second.
innodb_log_file_size 1G Default is 48M. Increase for more transactions per second.
innodb_flush_method O_DIRECT Bypass OS cache for better durability.
innodb_thread_concurrency 0 Allow InnoDB to manage thread concurrency level.
FOSDEM2021: MariaDB post-release quality assurance in Debian and UbuntuOtto Kekäläinen
Presentation slides from FOSDEM 2021.
Talk covers the MariaDB packaging in two of the most widely-used Linux distros, Debian and Ubuntu, including the strict requirements demanded by distros, and the impact on fixing bugs “upstream” in MariaDB itself.
How MariaDB packaging uses Salsa-CI to ensure smooth upgrades and avoid regre...Otto Kekäläinen
This document discusses how MariaDB in Debian uses the Salsa-CI/Gitlab-CI infrastructure to ensure smooth upgrades and avoid regressions. It describes how the MariaDB packaging repositories were moved to Salsa.Debian.org and how a custom Gitlab-CI pipeline with 18 jobs over 5 stages was created to build, test, and simulate upgrades from various versions. This comprehensive continuous integration process helps catch issues early and improve the quality and reliability of MariaDB upgrades. Challenges in testing such a large and complex package are also discussed.
This document discusses the state of MariaDB and MySQL packaging in Debian. MariaDB 10.3 is included in the latest stable Debian release, and 10.4 will be uploaded soon. MySQL 5.7 is available in unstable but not stable releases. There is ongoing work to maintain older MariaDB versions and develop new packages. Contributors are encouraged to participate in bug triage and discussions to help address stale bugs without coding skills.
This document discusses how to deploy a MariaDB Galera cluster on Ubuntu 14.04. It requires installing MariaDB, Galera, and Rsync on at least 3 Ubuntu nodes. Specific configuration files are edited to set the cluster address, node addresses, and other settings. The MySQL services are restarted and tests run to validate the cluster is functioning properly with data replicated across all nodes.
A brief introduction to MySQL (Group) Replication: what it is and some of the architecture.
Then, a highlight of the most important new replication features in MySQL 8 (as of 8.0.3 RC).
MySQL InnoDB Cluster and Group Replication - OSI 2017 BangaloreSujatha Sivakumar
The document discusses MySQL InnoDB Cluster and Group Replication. It provides an introduction and overview of InnoDB Cluster, outlining the key features and how to get an InnoDB Cluster up and running in 3 steps: deploying instances, creating a cluster, and adding more instances. It also covers setting up and starting a router. For Group Replication, it discusses the concept of replicating writes across multiple servers for high availability and read scaling. It shows how Group Replication achieves consensus on membership, message delivery and state updates across the group.
Tips to drive maria db cluster performance for nextcloudSeveralnines
200
● SSD
2000
● NVMe
4000
Tune for your hardware. Higher is better but avoid over-committing IOPS.
innodb_flush_log_at_trx_commit 1 Flush logs at each transaction commit for ACID compliance.
innodb_log_buffer_size 16M-64M Default is 8M. Increase for more transactions per second.
innodb_log_file_size 1G Default is 48M. Increase for more transactions per second.
innodb_flush_method O_DIRECT Bypass OS cache for better durability.
innodb_thread_concurrency 0 Allow InnoDB to manage thread concurrency level.
MariaDB adoption in Linux distributions and development environmentsOtto Kekäläinen
Presentation given at the M|17 MariaDB User Conference 2017
https://m17.mariadb.com/
Linux, Apache, MySQL and PHP used to be the most widely used web application stacks. As technology evolves, this is no longer the case. For the M part, MariaDB has replaced MySQL in numerous Linux distributions and development environments, and is becoming the new M in most production environments as well. This talk presents how the landscape looks today, and why and how web developers are migrating to MariaDB around the globe.
Slides: Introducing the new ClusterControl 1.2.9 - with live demo Severalnines
Highlights of ClusterControl 1.2.9 include:
Support for PostgreSQL Servers
Advanced HAProxy Configurations and Built-in Stats
Hybrid Replication with Galera Clusters
Galera Replication Traffic Encryption
Encrypted Communication between ClusterControl and MySQL-based systems
Query Deadlock Detection in MySQL-based systems
Bootstrap Galera Cluster
Restore of Backups
New UI theme
RPC interface to ClusterControl
Chef Recipe and Puppet Manifest for ClusterControl
Zabbix Plugin for ClusterControl
MySQL High Availability Solutions - Avoid loss of service by reducing the r...Olivier DASINI
MySQL High Availability Solutions
Avoid loss of service by reducing the risk of failures
MySQL InnoDB Cluster
Collection of products that work together to provide a complete High Availability solution for MySQL
MySQL InnoDB ReplicaSet
Administer a set of MySQL instances running asynchronous replication
MySQL NDB Cluster
A high-availability, high-redundancy version of MySQL adapted for the distributed computing environment
This document summarizes a presentation about MySQL Group Replication. The presentation discusses how Group Replication provides enhanced high availability for MySQL databases by allowing multiple MySQL servers to act as equal masters that can handle writes and remain available even if one server fails. It covers the theory behind Group Replication, how to configure and use it, and management of Group Replication deployments.
MySQL InnoDB Cluster - New Features in 8.0 Releases - Best PracticesKenny Gryp
MySQL InnoDB Cluster provides a complete high availability solution for MySQL. MySQL Shell includes AdminAPI which enables you to easily configure and administer a group of at least three MySQL server instances to function as an InnoDB cluster.
This talk includes best practices.
MySQL Group Replicatio in a nutshell - MySQL InnoDB ClusterFrederic Descamps
Group Replication is a plugin that provides multi-master replication for MySQL. It allows transactions to be executed on any node and replicated in a synchronous manner to all other nodes. The changes are delivered in total order to each node using GTIDs to ensure strong consistency across the cluster. Certification and application of the changes occurs asynchronously on each node after the writeset has been synchronously delivered.
MySQL InnoDB Cluster provides a complete, high-availability solution for MySQL. Learn how with a few easy-to-use Shell commands, how to set up a MySQL database architecture.
Some internal tools were relying on deprecated statements and behavior that changed in MySQL 5.6. The presenter had to update the tools to use the proper START SLAVE/STOP SLAVE statements and account for new information logged in binlogs due to configuration changes. Testing in pre-production helped uncover these issues so they could be addressed before upgrading production servers.
Meet MariaDB Server 10.1 London MySQL meetup December 2015Colin Charles
Meet MariaDB Server 10.1, the server that got released recently. Presented at the London MySQL Meetup in December 2015. Learn about the new features in MariaDB Server, especially around the focus of what we did to improve security.
Sharding and Scale-out using MySQL FabricMats Kindahl
MySQL Fabric is an open-source solution released by the MySQL Engineering team at Oracle. It make management of farms of MySQL servers easy and available for both applications with small and large number of servers.
This is the presentation from Percona Live Santa Clara.
9 DevOps Tips for Going in Production with Galera Cluster for MySQL - SlidesSeveralnines
Galera is a MySQL replication technology that can simplify the design of a high availability application stack. With a true multi-master MySQL setup, an application can now read and write from any database instance without worrying about master/slave roles, data integrity, slave lag or other drawbacks of asynchronous replication.
And that all sounds great until it’s time to go into production. Throw in a live migration from an existing database setup and devops life just got a bit more interesting ...
So if you are in devops, then this webinar is for you!
Operations is not so much about specific technologies, but about the techniques and tools you use to deploy and manage them. Monitoring, managing schema changes and pushing them in production, performance optimizations, configurations, version upgrades, backups; these are all aspects to consider – preferably before going live.
Let us guide you through 9 key tips to consider before taking Galera Cluster into production.
Webinar slides: ClusterControl 1.4: The MySQL Replication & MongoDB Edition -...Severalnines
ClusterControl reduces complexity of managing your database infrastructure while adding support for new technologies; enabling you to truly automate multiple environments for next-level applications. This latest release further builds out the functionality of ClusterControl to allow you to manage and secure your 24/7, mission critical infrastructures.
In this webinar, Johan demonstrated how ClusterControl increases your efficiency by giving you a single interface to deploy and operate your databases, instead of searching for and cobbling together a combination of open source tools, utilities and scripts that need constant updates and maintenance. Watch as ClusterControl demystifies the complexity associated with database high availability, load balancing, recovery and your other everyday struggles.
To put it simply: learn how to be a database hero with ClusterControl!
AGENDA
- ClusterControl (1.4) Overview
- ‘Always on Databases’ with enhanced MySQL Replication functions
- ‘Safer NoSQL’ with MongoDB and larger sharded cluster deployments
- ‘Enabling the DBA’ with ProxySQL, HAProxy and MaxScale
- Backing up your open source databases
- Live Demo
- Q&A
SPEAKER
Johan Andersson, CTO, Severalnines - Johan's technical background and interest are in high performance computing as demonstrated by the work he did on main-memory clustered databases at Ericsson as well as his research on parallel Java Virtual Machines at Trinity College Dublin in Ireland. Prior to co-founding Severalnines, Johan was Principal Consultant and lead of the MySQL Clustering & High Availability consulting group at MySQL / Sun Microsystems / Oracle, where he designed and implemented large-scale MySQL systems for key customers. Johan is a regular speaker at MySQL User Conferences as well as other high profile community gatherings with popular talks and tutorials around architecting and tuning MySQL Clusters.
This was a short 25 minute talk, but we go into a bit of a history of MySQL, how the branches and forks appeared, what's sticking around today (branch? Percona Server. Fork? MariaDB Server). What should you use? Think about what you need today and what the roadmap holds.
Slides used for the webinar: Introducing Galera 3.0 - Now supporting MySQL 5.6, Global Transaction IDs & WAN.
These slides covered the section: Galera Monitoring & Management
Setting up and maintaining a database cluster can be tricky. ClusterControl gives you the power to deploy, manage, monitor and scale entire clusters efficiently and reliably. ClusterControl supports a variety of SQL and NoSQL cluster topologies, as well as SQL load balancing via HAProxy.
Galera Cluster for MySQL is a true multi-master MySQL replication plugin, and has been proven in mission-critical infrastructures of companies like Ping Identity, AVG Technologies, KPN and HP Cloud DNS. In this webcast you¹ll learn about the following Galera Cluster capabilities, including the latest innovations in the new 3.0 release:
Galera Cluster features and benefits
Support for MySQL 5.6
Integration with MySQL Global Transaction Identifiers
Mixing Galera synchronous replication and asynchronous MySQL replication
Deploying in WAN and Cloud environments
Handling high-latency networks
Management of Galera
The document summarizes new features in MySQL 8.0.17, including the CLONE plugin for native automatic provisioning, multi-valued indexes, enhanced JSON functions using multi-valued indexes, JSON schema validation, a new binary collation for utf8mb4, improvements to MySQL Shell, MySQL Router, InnoDB Cluster, and Group Replication. It provides links to documentation and blogs for more information on each feature.
At the moment MySQL 8 and MariaDB 10.4 are the latest versions of the corresponding database management systems. Each of these DBMSs has a unique set of features, unavailable in its analogue (MariaDB features might be unavailable in MySQL, and vice versa). In this presentation, we’ll cover these new features and provide recommendations re: which application will work best on which DBMS.
MariaDB in Debian and Ubuntu: The next million usersOtto Kekäläinen
MariaDB is poised to become the default database package for Debian and Ubuntu distributions, which account for 60% of web servers. With over 300 million servers that could run the simple command 'apt-get install mariadb-server', MariaDB has the potential to gain many new users by being the default package. MySQL may be removed entirely from the next Debian release, with a Debian security team member confirming MariaDB 10.0 was chosen as the single database version for the upcoming Debian "stretch" release. MariaDB has fewer open bugs than MySQL in the Debian bug tracking system, further strengthening the case for it to become the primary database package.
Debian quality assurance systems – What can MariaDB developers learn from them?Otto Kekäläinen
Debian quality assurance systems – What can MariaDB developers learn from them?
Debian has one of the biggest CI systems ever, and all information is public. Once your software is there and you get all that QA for free, why not see what feedback the Debian QA systems give about it?
MariaDB adoption in Linux distributions and development environmentsOtto Kekäläinen
Presentation given at the M|17 MariaDB User Conference 2017
https://m17.mariadb.com/
Linux, Apache, MySQL and PHP used to be the most widely used web application stacks. As technology evolves, this is no longer the case. For the M part, MariaDB has replaced MySQL in numerous Linux distributions and development environments, and is becoming the new M in most production environments as well. This talk presents how the landscape looks today, and why and how web developers are migrating to MariaDB around the globe.
Slides: Introducing the new ClusterControl 1.2.9 - with live demo Severalnines
Highlights of ClusterControl 1.2.9 include:
Support for PostgreSQL Servers
Advanced HAProxy Configurations and Built-in Stats
Hybrid Replication with Galera Clusters
Galera Replication Traffic Encryption
Encrypted Communication between ClusterControl and MySQL-based systems
Query Deadlock Detection in MySQL-based systems
Bootstrap Galera Cluster
Restore of Backups
New UI theme
RPC interface to ClusterControl
Chef Recipe and Puppet Manifest for ClusterControl
Zabbix Plugin for ClusterControl
MySQL High Availability Solutions - Avoid loss of service by reducing the r...Olivier DASINI
MySQL High Availability Solutions
Avoid loss of service by reducing the risk of failures
MySQL InnoDB Cluster
Collection of products that work together to provide a complete High Availability solution for MySQL
MySQL InnoDB ReplicaSet
Administer a set of MySQL instances running asynchronous replication
MySQL NDB Cluster
A high-availability, high-redundancy version of MySQL adapted for the distributed computing environment
This document summarizes a presentation about MySQL Group Replication. The presentation discusses how Group Replication provides enhanced high availability for MySQL databases by allowing multiple MySQL servers to act as equal masters that can handle writes and remain available even if one server fails. It covers the theory behind Group Replication, how to configure and use it, and management of Group Replication deployments.
MySQL InnoDB Cluster - New Features in 8.0 Releases - Best PracticesKenny Gryp
MySQL InnoDB Cluster provides a complete high availability solution for MySQL. MySQL Shell includes AdminAPI which enables you to easily configure and administer a group of at least three MySQL server instances to function as an InnoDB cluster.
This talk includes best practices.
MySQL Group Replicatio in a nutshell - MySQL InnoDB ClusterFrederic Descamps
Group Replication is a plugin that provides multi-master replication for MySQL. It allows transactions to be executed on any node and replicated in a synchronous manner to all other nodes. The changes are delivered in total order to each node using GTIDs to ensure strong consistency across the cluster. Certification and application of the changes occurs asynchronously on each node after the writeset has been synchronously delivered.
MySQL InnoDB Cluster provides a complete, high-availability solution for MySQL. Learn how with a few easy-to-use Shell commands, how to set up a MySQL database architecture.
Some internal tools were relying on deprecated statements and behavior that changed in MySQL 5.6. The presenter had to update the tools to use the proper START SLAVE/STOP SLAVE statements and account for new information logged in binlogs due to configuration changes. Testing in pre-production helped uncover these issues so they could be addressed before upgrading production servers.
Meet MariaDB Server 10.1 London MySQL meetup December 2015Colin Charles
Meet MariaDB Server 10.1, the server that got released recently. Presented at the London MySQL Meetup in December 2015. Learn about the new features in MariaDB Server, especially around the focus of what we did to improve security.
Sharding and Scale-out using MySQL FabricMats Kindahl
MySQL Fabric is an open-source solution released by the MySQL Engineering team at Oracle. It make management of farms of MySQL servers easy and available for both applications with small and large number of servers.
This is the presentation from Percona Live Santa Clara.
9 DevOps Tips for Going in Production with Galera Cluster for MySQL - SlidesSeveralnines
Galera is a MySQL replication technology that can simplify the design of a high availability application stack. With a true multi-master MySQL setup, an application can now read and write from any database instance without worrying about master/slave roles, data integrity, slave lag or other drawbacks of asynchronous replication.
And that all sounds great until it’s time to go into production. Throw in a live migration from an existing database setup and devops life just got a bit more interesting ...
So if you are in devops, then this webinar is for you!
Operations is not so much about specific technologies, but about the techniques and tools you use to deploy and manage them. Monitoring, managing schema changes and pushing them in production, performance optimizations, configurations, version upgrades, backups; these are all aspects to consider – preferably before going live.
Let us guide you through 9 key tips to consider before taking Galera Cluster into production.
Webinar slides: ClusterControl 1.4: The MySQL Replication & MongoDB Edition -...Severalnines
ClusterControl reduces complexity of managing your database infrastructure while adding support for new technologies; enabling you to truly automate multiple environments for next-level applications. This latest release further builds out the functionality of ClusterControl to allow you to manage and secure your 24/7, mission critical infrastructures.
In this webinar, Johan demonstrated how ClusterControl increases your efficiency by giving you a single interface to deploy and operate your databases, instead of searching for and cobbling together a combination of open source tools, utilities and scripts that need constant updates and maintenance. Watch as ClusterControl demystifies the complexity associated with database high availability, load balancing, recovery and your other everyday struggles.
To put it simply: learn how to be a database hero with ClusterControl!
AGENDA
- ClusterControl (1.4) Overview
- ‘Always on Databases’ with enhanced MySQL Replication functions
- ‘Safer NoSQL’ with MongoDB and larger sharded cluster deployments
- ‘Enabling the DBA’ with ProxySQL, HAProxy and MaxScale
- Backing up your open source databases
- Live Demo
- Q&A
SPEAKER
Johan Andersson, CTO, Severalnines - Johan's technical background and interest are in high performance computing as demonstrated by the work he did on main-memory clustered databases at Ericsson as well as his research on parallel Java Virtual Machines at Trinity College Dublin in Ireland. Prior to co-founding Severalnines, Johan was Principal Consultant and lead of the MySQL Clustering & High Availability consulting group at MySQL / Sun Microsystems / Oracle, where he designed and implemented large-scale MySQL systems for key customers. Johan is a regular speaker at MySQL User Conferences as well as other high profile community gatherings with popular talks and tutorials around architecting and tuning MySQL Clusters.
This was a short 25 minute talk, but we go into a bit of a history of MySQL, how the branches and forks appeared, what's sticking around today (branch? Percona Server. Fork? MariaDB Server). What should you use? Think about what you need today and what the roadmap holds.
Slides used for the webinar: Introducing Galera 3.0 - Now supporting MySQL 5.6, Global Transaction IDs & WAN.
These slides covered the section: Galera Monitoring & Management
Setting up and maintaining a database cluster can be tricky. ClusterControl gives you the power to deploy, manage, monitor and scale entire clusters efficiently and reliably. ClusterControl supports a variety of SQL and NoSQL cluster topologies, as well as SQL load balancing via HAProxy.
Galera Cluster for MySQL is a true multi-master MySQL replication plugin, and has been proven in mission-critical infrastructures of companies like Ping Identity, AVG Technologies, KPN and HP Cloud DNS. In this webcast you¹ll learn about the following Galera Cluster capabilities, including the latest innovations in the new 3.0 release:
Galera Cluster features and benefits
Support for MySQL 5.6
Integration with MySQL Global Transaction Identifiers
Mixing Galera synchronous replication and asynchronous MySQL replication
Deploying in WAN and Cloud environments
Handling high-latency networks
Management of Galera
The document summarizes new features in MySQL 8.0.17, including the CLONE plugin for native automatic provisioning, multi-valued indexes, enhanced JSON functions using multi-valued indexes, JSON schema validation, a new binary collation for utf8mb4, improvements to MySQL Shell, MySQL Router, InnoDB Cluster, and Group Replication. It provides links to documentation and blogs for more information on each feature.
At the moment MySQL 8 and MariaDB 10.4 are the latest versions of the corresponding database management systems. Each of these DBMSs has a unique set of features, unavailable in its analogue (MariaDB features might be unavailable in MySQL, and vice versa). In this presentation, we’ll cover these new features and provide recommendations re: which application will work best on which DBMS.
MariaDB in Debian and Ubuntu: The next million usersOtto Kekäläinen
MariaDB is poised to become the default database package for Debian and Ubuntu distributions, which account for 60% of web servers. With over 300 million servers that could run the simple command 'apt-get install mariadb-server', MariaDB has the potential to gain many new users by being the default package. MySQL may be removed entirely from the next Debian release, with a Debian security team member confirming MariaDB 10.0 was chosen as the single database version for the upcoming Debian "stretch" release. MariaDB has fewer open bugs than MySQL in the Debian bug tracking system, further strengthening the case for it to become the primary database package.
Debian quality assurance systems – What can MariaDB developers learn from them?Otto Kekäläinen
Debian quality assurance systems – What can MariaDB developers learn from them?
Debian has one of the biggest CI systems ever, and all information is public. Once your software is there and you get all that QA for free, why not see what feedback the Debian QA systems give about it?
DebConf 2020: What’s New in MariaDB Server 10.5 and Galera 4?Otto Kekäläinen
MariaDB has now reached the 10th major release since the original authors of MySQL started taking the code base in another direction than where MySQL is going under Oracle’s ownership. Today MariaDB has many more features than Oracle MySQL and it is the default MySQL variant in Debian.
This presentation covers what new features landed in MariaDB 10.5 and also touches on how the long existing features have evolved to today, and naturally what is their state and best practices for Debian users. MariaDB has also built-in support for Galera master-master replication and Galera 4 has recently landed in Debian, so it will also be covered.
The document discusses plans for MySQL and MariaDB packages in Debian. It notes that MariaDB will become the default over MySQL. It provides a list of tasks for improving the MariaDB packages, including adding tags, optional feedback plugins, systemd scripts, and autopkg tests. It also discusses some more difficult tasks such as reproducible builds and using an open-source SSL library instead of the bundled YaSSL.
Less passwords, more security: unix socket authentication and other MariaDB h...Otto Kekäläinen
This document discusses securing MariaDB installations through socket authentication and user account management. It recommends configuring MariaDB to use socket authentication for the root user instead of passwords to eliminate the need for root password management across servers. It also recommends creating individual user accounts with passwords for applications instead of shared accounts, restricting MariaDB to only listen on localhost, encrypting connections using SSL, and encrypting data at rest. The document provides configuration examples for implementing these recommendations in MariaDB.
MariaDB 10.2 & MariaDB 10.1 by Michael Monty Widenius at Database Camp 2016 @ UN✔ Eric David Benari, PMP
This document summarizes features in MariaDB 10.1 and 10.2. It discusses how MariaDB was created to ensure a free and community developed version of MySQL always exists. It provides overviews of the MariaDB foundation and goals. It also summarizes many new features and improvements in areas like performance, replication, security and more.
This document discusses different versions of popular open-source SQL databases and how to install and configure MySQL. It lists versions of MySQL, MariaDB, Percona, and XtraDB Cluster and how to download, install, start, and connect to MySQL. It also shows how to install MySQL using Debian packages or RPMs, how to view server configuration settings, and how to set permissions to allow remote root connections.
MariaDB is a community-developed, drop-in replacement for MySQL that aims to be fully compatible without compromising on features or stability. Over the past 32 months, MariaDB has released four major versions with new features like improved replication, optimization enhancements, and storage engines. It is led by many of the original developers of MySQL and has a large community of contributors working to advance it as a better open source database.
Distro Recipes 2013 : Debian and quality assuranceAnne Nicolas
The document discusses Debian's quality assurance processes. It describes how Debian is known for its long release cycles and high quality. It then outlines several factors that contribute to Debian's quality, including its release-when-ready culture, package ownership model, and focus on fixing release-critical bugs. The remainder of the document details Debian's quality assurance team and their tasks, such as performing archive-wide checks, rebuilds, and static analysis to find bugs. It also discusses the infrastructure developed to support these quality assurance activities.
This document summarizes a talk given by Michael "Monty" Widenius about reasons to switch to MariaDB 10.0 from MySQL 5.5 or MariaDB 5.5. The talk addresses why MariaDB was created, features of MariaDB releases, benchmarks, the role of the MariaDB foundation, and reasons to switch. It provides information on the MariaDB foundation goals of developing and distributing MariaDB openly. It outlines many new features in MariaDB 10.0 including new storage engines, replication features, functionality, and improvements in areas like speed, optimization, and usability.
MariaDB is an open-source relational database management system that was created to be more open and community-focused than its predecessor, MySQL. It was founded in 2009 by the original developers of MySQL after Oracle acquired Sun Microsystems. MariaDB aims to preserve the open nature of MySQL by using an open governance model and keeping its code open source under GPL. It has become the default database in several major Linux distributions and is available on major cloud platforms. MariaDB provides an enterprise-grade database with high availability, performance, scalability and security features.
At the moment MySQL 8 and MariaDB 10.4 are the latest versions of the corresponding database management systems. Each of these DBMSs has a unique set of features, unavailable in its analogue (MariaDB features might be unavailable in MySQL, and vice versa). In this presentation, we’ll cover these new features and provide recommendations re: which application will work best on which DBMS.
Attendees will be able to identify what focus areas that either MySQL or MariaDB targeted. This talk also gives a great overview of what are the benefits of using one over another.
This document discusses how to set up a MySQL Docker container. It begins with an introduction to Docker and overview of MySQL. It then explains how to configure a MySQL instance using environment variables when starting the MySQL image. It also demonstrates starting a MySQL container using the docker run command with appropriate arguments and environment variables. Finally, it discusses using a data-only container to share data between MySQL containers.
The document discusses MariaDB 5.5 and the future of MariaDB, noting that MariaDB aims to be a drop-in replacement for MySQL that is fully compatible but with additional features; it provides an overview of MariaDB's history and major releases from 5.1 to 5.5; and it outlines some of MariaDB's goals and plans for the future, including the 10.0 release and incorporating additional storage engines.
The document discusses Ada support in Fedora Linux. It provides an overview of Fedora's goals of advancing free software. It then discusses reasons for supporting Ada in Fedora, including using modern compilers and tools as well as virtualization support. It outlines current packaging issues and guidelines. It lists existing Ada packages and plans to improve support, including adding ARM/ARM64 support and new packages. It provides resources for the Ada community in Fedora.
The document discusses MyRocks being included in MariaDB. Some key points:
- MyRocks is a storage engine that combines RocksDB with MySQL/MariaDB for better performance.
- MyRocks is now included in MariaDB 10.2 as an alpha plugin, with binaries/packages available. Many features work but some like binlog/replication are still in progress.
- MariaDB will continue merging updates from the MyRocks upstream project and work to increase the plugin's maturity level.
- Future plans include finishing core features like binlog/replication support, packaging backup tools, and ensuring compatibility with MariaDB features like global variables and GTID replication.
Webseminar: MariaDB Enterprise und MariaDB Enterprise ClusterMariaDB Corporation
This document provides information about MariaDB Enterprise and MariaDB Enterprise Cluster from Ralf Gebhardt, including:
- An agenda covering MariaDB, MariaDB Enterprise, MariaDB Enterprise Cluster, services, and more info.
- Background on MariaDB, the MariaDB Foundation, MariaDB.com, and SkySQL.
- A timeline of MariaDB releases from 5.1 to the current 10.0 and Galera Cluster 10.
- An overview of key features and optimizations in MariaDB 10 like multi-source replication and improved query optimization.
- Mention of Fusion-IO page compression providing a 30% performance increase with atomic writes.
Similar a MariaDB quality assurance in Debian and Ubuntu (20)
Search in WordPress - how it works and howto customize itOtto Kekäläinen
WordPress search customization is a topic we at Seravo get asked about on a frequent basis. There are many different ways to customize the search, and customers understandably want to learn the best practices. The search can be customized quite easily with small changes on PHP code level, and by utilizing MariaDB database’s built-in search functionality. You can also choose a more robust way to do this, and build a new ElasticSearch server just for your case.
These slides are from the webinar on January 14th, 2021: https://seravo.com/blog/webinar-search-function-and-how-to-customize-it/
The 5 most common reasons for a slow WordPress site and how to fix them – ext...Otto Kekäläinen
Presentation given in WP Meetup in October 2019.
Includes fresh new tips from summer/fall 2019!
A Must read for all WordPress site owners and developers.
How to investigate and recover from a security breach in WordPressOtto Kekäläinen
This document summarizes Otto Kekäläinen's talk about investigating and recovering from a WordPress security breach at his company Seravo. On November 9th, 2018 four WordPress sites hosted by Seravo were compromised due to a vulnerability in the WP GDPR Compliance plugin. Seravo's security team launched an investigation that uncovered malicious user accounts, identified the vulnerable plugin as the entry point, and cleaned up the sites. The experience highlighted the importance of having an incident response plan even when security best practices are followed.
Automatic testing and quality assurance for WordPress plugins and themesOtto Kekäläinen
Talk given at WP Helsinki Meetup 7.11.2018
See also:
* https://developer.wordpress.org/themes
* https://developer.wordpress.org/plugins
* https://travis-ci.org/Seravo
* https://seravo.com/blog/coding-wordpress-in-style-with-phpcs/
10 things every developer should know about their database to run word press ...Otto Kekäläinen
Talk from WordCamp Barcelona 2018
https://2018.barcelona.wordcamp.org/session/10-things-every-developer-should-know-about-their-database-to-run-wordpress-optimally/
The database is perhaps the most important piece of your infrastructure. The database contains all your important e-commerce data and must be kept secured. The database performance often defines the overall performance of your WordPress site. In this talk I the most important things every WordPress developer should know about MariaDB/MySQL to be able to build and operate their site optimally.
Automatic testing and quality assurance for WordPress pluginsOtto Kekäläinen
Talk given at WordCamp Jyväskylä 2018
WordPress plugins have a reputation of low quality. Help us prove them wrong. Start using automatic quality testing!
WordPressin tietoturva: Mikä on olennaista – ja mikä ei?
Esitys WP Seinäjoki Meetupissa 28.11.2017
Tietoa kaikille jotka omistavat WordPress-sivuston tai kehittävät WordPress-sivustoja.
Improving WordPress Performance with Xdebug and PHP ProfilingOtto Kekäläinen
Presentation given at WordCamp Europe 2017 in Paris 2017-06-16.
Xdebug is a tool for developers to gain insight into how PHP is executed. Using it for profiling is a very effective, fast and precise method to find bottlenecks in your WordPress site. In this talk I explain how to use it with Webgrind, how to find potential optimization targets, show examples of real cases when Xdebug helped fix a performance problem and also explain what Xdebug is not suitable for and what can be used instead. If you are not a developer, you’ll learn what Xdebug is capable of and when to ask a developer to use it.
Presentation given at the WP Jyväksylä Meetup March 21st, 2017. This revised version contains references to the WordPress security news that circulated in February 2017.
WordPress security 101 - WP Turku Meetup 2.2.2017Otto Kekäläinen
This document provides an overview of WordPress security best practices. It defines information security as confidentiality, integrity and availability. Potential security consequences of an unsecured WordPress site are discussed, such as a corrupted database preventing orders or payments. The document emphasizes that keeping passwords secure, using HTTPS, minimizing plugins/themes, and maintaining regular backups are most important. It advises against relying on security plugins for a false sense of security and recommends trusting hosting providers to handle DDoS protection and other security measures.
Find WordPress performance bottlenecks with XDebug PHP profilingOtto Kekäläinen
XDebug is a tool that allows developers to profile PHP applications to identify bottlenecks and anomalies. It works by instrumenting PHP code during execution and collecting metrics on runtime performance. The document provides instructions on installing XDebug, taking profiling samples of a WordPress site, and analyzing the results with Webgrind to identify expensive functions and optimize performance. With repeated profiling and analysis, developers can pinpoint specific code causing issues and refactor it for better efficiency.
Testing and updating WordPress - Advanced techniques for avoiding regressionsOtto Kekäläinen
This document discusses techniques for safely updating WordPress core and plugins to avoid regressions. It recommends setting up a "shadow" test site to first update and thoroughly regression test plugins and themes before deploying updates to the production site. Integration tests can automate aspects of regression testing by programmatically interacting with and validating the site. Visual regression testing can additionally detect layout or design changes. While most updates can be safely automated, some human oversight is still important to determine if changes constitute failures.
This document provides best practices and guidelines for using Git version control. It discusses topics such as why version control is important, how to write good commit messages, reviewing code changes, using branches, and more. The key recommendations are to focus commit messages on the why rather than what changed, get code reviews on the master branch, and never force push to master to avoid diverging versions.
Build applications with generative AI on Google CloudMárton Kodok
We will explore Vertex AI - Model Garden powered experiences, we are going to learn more about the integration of these generative AI APIs. We are going to see in action what the Gemini family of generative models are for developers to build and deploy AI-driven applications. Vertex AI includes a suite of foundation models, these are referred to as the PaLM and Gemini family of generative ai models, and they come in different versions. We are going to cover how to use via API to: - execute prompts in text and chat - cover multimodal use cases with image prompts. - finetune and distill to improve knowledge domains - run function calls with foundation models to optimize them for specific tasks. At the end of the session, developers will understand how to innovate with generative AI and develop apps using the generative ai industry trends.
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...Social Samosa
The Modern Marketing Reckoner (MMR) is a comprehensive resource packed with POVs from 60+ industry leaders on how AI is transforming the 4 key pillars of marketing – product, place, price and promotions.
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeWalaa Eldin Moustafa
Dynamic policy enforcement is becoming an increasingly important topic in today’s world where data privacy and compliance is a top priority for companies, individuals, and regulators alike. In these slides, we discuss how LinkedIn implements a powerful dynamic policy enforcement engine, called ViewShift, and integrates it within its data lake. We show the query engine architecture and how catalog implementations can automatically route table resolutions to compliance-enforcing SQL views. Such views have a set of very interesting properties: (1) They are auto-generated from declarative data annotations. (2) They respect user-level consent and preferences (3) They are context-aware, encoding a different set of transformations for different use cases (4) They are portable; while the SQL logic is only implemented in one SQL dialect, it is accessible in all engines.
#SQL #Views #Privacy #Compliance #DataLake
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataKiwi Creative
Harness the power of AI-backed reports, benchmarking and data analysis to predict trends and detect anomalies in your marketing efforts.
Peter Caputa, CEO at Databox, reveals how you can discover the strategies and tools to increase your growth rate (and margins!).
From metrics to track to data habits to pick up, enhance your reporting for powerful insights to improve your B2B tech company's marketing.
- - -
This is the webinar recording from the June 2024 HubSpot User Group (HUG) for B2B Technology USA.
Watch the video recording at https://youtu.be/5vjwGfPN9lw
Sign up for future HUG events at https://events.hubspot.com/b2b-technology-usa/
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...Kaxil Naik
Navigating today's data landscape isn't just about managing workflows; it's about strategically propelling your business forward. Apache Airflow has stood out as the benchmark in this arena, driving data orchestration forward since its early days. As we dive into the complexities of our current data-rich environment, where the sheer volume of information and its timely, accurate processing are crucial for AI and ML applications, the role of Airflow has never been more critical.
In my journey as the Senior Engineering Director and a pivotal member of Apache Airflow's Project Management Committee (PMC), I've witnessed Airflow transform data handling, making agility and insight the norm in an ever-evolving digital space. At Astronomer, our collaboration with leading AI & ML teams worldwide has not only tested but also proven Airflow's mettle in delivering data reliably and efficiently—data that now powers not just insights but core business functions.
This session is a deep dive into the essence of Airflow's success. We'll trace its evolution from a budding project to the backbone of data orchestration it is today, constantly adapting to meet the next wave of data challenges, including those brought on by Generative AI. It's this forward-thinking adaptability that keeps Airflow at the forefront of innovation, ready for whatever comes next.
The ever-growing demands of AI and ML applications have ushered in an era where sophisticated data management isn't a luxury—it's a necessity. Airflow's innate flexibility and scalability are what makes it indispensable in managing the intricate workflows of today, especially those involving Large Language Models (LLMs).
This talk isn't just a rundown of Airflow's features; it's about harnessing these capabilities to turn your data workflows into a strategic asset. Together, we'll explore how Airflow remains at the cutting edge of data orchestration, ensuring your organization is not just keeping pace but setting the pace in a data-driven future.
Session in https://budapestdata.hu/2024/04/kaxil-naik-astronomer-io/ | https://dataml24.sessionize.com/session/667627
Global Situational Awareness of A.I. and where its headedvikram sood
You can see the future first in San Francisco.
Over the past year, the talk of the town has shifted from $10 billion compute clusters to $100 billion clusters to trillion-dollar clusters. Every six months another zero is added to the boardroom plans. Behind the scenes, there’s a fierce scramble to secure every power contract still available for the rest of the decade, every voltage transformer that can possibly be procured. American big business is gearing up to pour trillions of dollars into a long-unseen mobilization of American industrial might. By the end of the decade, American electricity production will have grown tens of percent; from the shale fields of Pennsylvania to the solar farms of Nevada, hundreds of millions of GPUs will hum.
The AGI race has begun. We are building machines that can think and reason. By 2025/26, these machines will outpace college graduates. By the end of the decade, they will be smarter than you or I; we will have superintelligence, in the true sense of the word. Along the way, national security forces not seen in half a century will be un-leashed, and before long, The Project will be on. If we’re lucky, we’ll be in an all-out race with the CCP; if we’re unlucky, an all-out war.
Everyone is now talking about AI, but few have the faintest glimmer of what is about to hit them. Nvidia analysts still think 2024 might be close to the peak. Mainstream pundits are stuck on the wilful blindness of “it’s just predicting the next word”. They see only hype and business-as-usual; at most they entertain another internet-scale technological change.
Before long, the world will wake up. But right now, there are perhaps a few hundred people, most of them in San Francisco and the AI labs, that have situational awareness. Through whatever peculiar forces of fate, I have found myself amongst them. A few years ago, these people were derided as crazy—but they trusted the trendlines, which allowed them to correctly predict the AI advances of the past few years. Whether these people are also right about the next few years remains to be seen. But these are very smart people—the smartest people I have ever met—and they are the ones building this technology. Perhaps they will be an odd footnote in history, or perhaps they will go down in history like Szilard and Oppenheimer and Teller. If they are seeing the future even close to correctly, we are in for a wild ride.
Let me tell you what we see.
End-to-end pipeline agility - Berlin Buzzwords 2024Lars Albertsson
We describe how we achieve high change agility in data engineering by eliminating the fear of breaking downstream data pipelines through end-to-end pipeline testing, and by using schema metaprogramming to safely eliminate boilerplate involved in changes that affect whole pipelines.
A quick poll on agility in changing pipelines from end to end indicated a huge span in capabilities. For the question "How long time does it take for all downstream pipelines to be adapted to an upstream change," the median response was 6 months, but some respondents could do it in less than a day. When quantitative data engineering differences between the best and worst are measured, the span is often 100x-1000x, sometimes even more.
A long time ago, we suffered at Spotify from fear of changing pipelines due to not knowing what the impact might be downstream. We made plans for a technical solution to test pipelines end-to-end to mitigate that fear, but the effort failed for cultural reasons. We eventually solved this challenge, but in a different context. In this presentation we will describe how we test full pipelines effectively by manipulating workflow orchestration, which enables us to make changes in pipelines without fear of breaking downstream.
Making schema changes that affect many jobs also involves a lot of toil and boilerplate. Using schema-on-read mitigates some of it, but has drawbacks since it makes it more difficult to detect errors early. We will describe how we have rejected this tradeoff by applying schema metaprogramming, eliminating boilerplate but keeping the protection of static typing, thereby further improving agility to quickly modify data pipelines without fear.
Open Source Contributions to Postgres: The Basics POSETTE 2024ElizabethGarrettChri
Postgres is the most advanced open-source database in the world and it's supported by a community, not a single company. So how does this work? How does code actually get into Postgres? I recently had a patch submitted and committed and I want to share what I learned in that process. I’ll give you an overview of Postgres versions and how the underlying project codebase functions. I’ll also show you the process for submitting a patch and getting that tested and committed.
Intelligence supported media monitoring in veterinary medicine
MariaDB quality assurance in Debian and Ubuntu
1. Debian, Ubuntu & MariaDB
MariaDB post-release
quality assurance in
Debian and Ubuntu
Follow
@ottokekalainen
for
insight
about
the
open
source
world!
MariaDB Server Minifest
9th
of December 2020
2. ~60 % of web
servers run
Debian or Ubuntu
apt install mariadb-server
w3techs.com/technologies/details/os-linux
3. Debian
Mother of all (or most)
Linux distros
commons.wikimedia.org/wiki/File:Linux_
Distribution_Timeline.svg
5. MariaDB and MySQL timeline
MariaDB 5.1
MariaDB 5.5
shipped in Debian 8 MariaDB 10.0
shipped in Debian 9 MariaDB 10.1
MariaDB 10.2
shipped in Debian 10 MariaDB 10.3
MariaDB 10.4
ships in Debian 11 MariaDB 10.5
MySQL 5.1 shipped in Debian 6
MySQL 5.5 shipped in Debian 7 and 8
MySQL 5.6
MySQL 5.7
MySQL 8.0
GA
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
6. State of MariaDB and MySQL in Debian
● MariaDB 10.3 in Buster (latest Debian stable release)
● MariaDB 10.5 in Bullseye (next Debian stable release)
● Galera 3 in Buster
● Galera 4 in Bullseye
○ also in Buster-backports and Stretch-backports
● No MySQL in stable Debian releases since Jessie
○ Exists in Debian unstable but will not migrate to testing and stable
○ Debian unstable had MySQL 5.7 for years, MySQL 8.0 since fall 2020
● mysql-defaults define the settings
○ Debian defaults to MariaDB as decided by the Debian release team
○ Ubuntu defaults to Oracle MySQL as decided by Canonical
7. MariaDB versions in Debian/Ubuntu
packages.debian.org/search?lang=en&suite=all&searchon=n
ames&keywords=mariadb-server
packages.ubuntu.com/search?lang=en&suite=all&searchon=
names&keywords=mariadb-server
9. Release flow in Debian
● There is a copy of MariaDB
sources at
salsa.debian.org/mariadb-team/
● Tool “uscan” is used to check
for new upstream releases = a
new tar.gz package to download
and import into Debian
● Packaging is done into the
debian/ directory
○ Upstream release: 10.5.8
○ Debian revision: 10.5.8-3
● Only Debian Developers can
upload to the Debian archive
11. Security releases cause challenges for quality assurance
ubuntu.com/security/notices/USN-4603-1www.debian.org/security/2020/dsa-4776
12. The Debian Policy
Linux distributions love
stability, standards and
quality!
The Debian Policy Manual
alone spans 150 pages
debian.org/doc/debian-policy/
20. Also in Ubuntu: autopkgtest.ubuntu.com
Piu Exactly the same
debci /
autopkgtests
tests and runner,
but in the Ubuntu
archive instead.
21. QA systems in Debian: piuparts.debian.org
Piu Tests installs,
upgrades,
removals etc
package
life-cycle.
22. QA systems in Debian: Lintian
Command-line tool and website that
runs thousands of checks that
analyze the package and suggest
fixes to the source, packaging or
the software itself (e.g.
spelling).
Many Lintian found issues are
useful to fix for all distros and
platforms, not just Debian.
27. Ubuntu users might file MariaDB bugs on Launchpad
bugs.launchpad.net/ubuntu/+source/mariadb-10.5
28. Eventually all
downstream fixes
flow also
upstream
debian/patches$ grep Forwarded *
928230-mysql_config---libmysqld-libs.patch:
Forwarded:
github.com/MariaDB/mariadb-connector-c/pull/109
hurd.patch:
Forwarded:
github.com/MariaDB/server/pull/918#discussion_r2
31432905
MDEV-18768-automate-auth_socket-to_unix_socket-u
pgrade.patch:
Forwarded: jira.mariadb.org/browse/MDEV-18768
mroonga-path-reproducible-build.patch:
Forwarded: github.com/mroonga/mroonga/issues/298
29. Plenty of work in both
developing new and maintaining old
Contributors welcome!
30. Please join!
You don’t have to be a
coder/developer to help,
there are plenty of other
valued skills as well!
● Participate in
bugs.debian.org
discussions!
● Send merge requests on
Salsa:
wiki.debian.org/Teams/MySQL/patches
● Contribute upstream:
mariadb.org/get-involved
● Join pkg-mysql-maint
mailing list
alioth-lists.debian.net/cgi-bin/mailman/listinfo/p
kg-mysql-maint