You are viewing kristiannielsen

Kristian Nielsen - The future of replication revealed in Istanbul
October 11th, 2010
05:32 pm

[Link]

Previous Entry Add to Memories Share Next Entry
The future of replication revealed in Istanbul

A very good meeting in Istanbul is drawing to an end. People from Monty Program, Facebook, Galera, Percona, SkySQL, and other parts of the community are meeting with one foot on the European continent and another in Asia to discuss all things MariaDB and MySQL and experience the mystery of the Orient.

At the meeting I had the opportunity to present my plans and visions for the future development of replication in MariaDB. My talk was very well received, and I had a lot of good discussions afterwards with many of the bright people here. Working from home in a virtual company, it means a lot to get this kind of inspiration and encouragement from others on occasion, and I am looking forward to continuing the work after an early flight to Copenhagen tomorrow.

The new interface for transaction coordinator plugins is what particularly interests me at the moment. The immediate benefit of this work is working group commit for transactions with the binary log enabled. But just as interesting (if more subtle), the project is an enabler for several other nice features related to hot backup and recovery. I spent a lot of effort working on the interfaces to the transaction controller and related extensions to the storage engine API, and I think the result is quite solid and a good basis for coming work.

After the transaction coordinator plugin, the next step is an API for event generators that will allow plugins to receive replication events on an equal footing with the built-in MySQL binary log implementation; I will be using this in cooperation with Codership to more tightly integrate their Galera synchronous replication into MariaDB. And long-term, I am hoping to combine all of the pieces to finally start attacking the general problem of parallel execution of events on replication slaves, the solution of which is long overdue.

(The MariaDB replication project page has lots of pointers to more information on the various projects for anyone interested).

Almost too good to be true, out excursion today was blessed with sunshine and mild weather after countless days of rain and storm. There were even rumours of sightings of dolphins jumping again during the SkySQL excursion yesterday. So while lots of hard work remains, all in all, the omens seem all good for the future of replication in MariaDB!

Tags: , , , ,

(11 comments | Leave a comment)

Comments
 
[User Picture]
From:zamotivator
Date:October 11th, 2010 06:09 pm (UTC)
(Link)
Kristian,

This is very important features for all MySQL world. Thank you for your work!

Oleg T., Percona

Edited at 2010-10-11 11:09 pm (UTC)
[User Picture]
From:Henrik Ingo
Date:October 13th, 2010 01:47 pm (UTC)

Thanks

(Link)
Oleg, thanks also for your participation and the discussion we had on XtraDB. Very useful to meet!
[User Picture]
From:zamotivator
Date:October 13th, 2010 01:48 pm (UTC)

Re: Thanks

(Link)
:)
[User Picture]
From:swanhart
Date:October 11th, 2010 10:58 pm (UTC)

Third party replication

(Link)
I'm very much interested in plugins that will get replication events.

I'd say that for "global transaction id" a monotonically increasing id is much more useful than binary log position.

How will it work when there is more than one transactional storage engine involved?

From:kristiannielsen
Date:October 13th, 2010 05:10 am (UTC)

Re: Third party replication

(Link)
Agree that a monotonically increasing id is what we need.

With respect to working with multiple transactional storage engines: One aspect is that the work on transaction coordinator and group commit that I am currently wrapping up is to ensure consistent commit order between all engines and binlog. This means that one will not see a transaction committed in one engine/binlog but not another (which would be a problem for global transaction id). Maybe this is what you had in mind?
[User Picture]
From:swanhart
Date:October 13th, 2010 05:34 am (UTC)

Re: Third party replication

(Link)
So a transaction can only succeed if a) commit succeeds in all engines and b) it is logged into the binlog for all engines, right? Well, at least for engines that support XA.
From:kristiannielsen
Date:October 13th, 2010 06:29 am (UTC)

Re: Third party replication

(Link)
yes, you are right
From:(Anonymous)
Date:January 17th, 2011 05:00 am (UTC)

Аудио-курс от НЛП-Тренера

(Link)
[url=http://god-n-devil-inc.livejournal.com/13959.html]Дизайн внутренних состояний[/url]
From:(Anonymous)
Date:January 22nd, 2011 02:47 pm (UTC)
(Link)
i enjoy exactly how you receive your level throughout.
From:(Anonymous)
Date:February 11th, 2011 11:42 pm (UTC)

vuitton bag

(Link)
Many thanks for support how I can thank you?
From:(Anonymous)
Date:March 20th, 2011 08:53 pm (UTC)
(Link)
Hey all, I do really enjoy the actual internet-site!! This is certainly a fabulous page. All of us look forward to reading even more interesting information in which you’ll turn out to be publishing in the future. I have learned a whole lot by this. Thanks for your insight.
Powered by LiveJournal.com