summaryrefslogtreecommitdiff
path: root/sql/pgq/structure
AgeCommit message (Collapse)Author
2013-12-03sql/pgq: tag pgq.batch_id_seq as dumpable (extension)Marko Kreen
That case was broken in old 9.1 releases, fixed since 9.1.7. The sequence will be owned by extension and without tagging it will not be dumped in data dump.
2013-09-20sql/pgq: fix retry-queue vs. newgrantsMarko Kreen
2013-03-04More newgrants fixes..Marko Kreen
2013-03-03more newgrants fixes.Marko Kreen
mostly works now. only problem is that londiste_writer needs to be superuser because of session_replication_role. That can be fixed with secdef function, but that means code needs to be installed separately.
2012-11-02pgq: quote internal table namesMarko Kreen
Quoting was not done previosly as the table names come not from user input but from internal tables. But understanding whether it's safe in particular setup requires extra thinking which is not good. So to remove the need for thinking, lets quote everything properly.
2012-07-19sql/pgq: Don't tag batch_id_seq as dumpable, pg_dump is broken.Marko Kreen
This means it's value will be lost during dump+restore.
2012-07-13Convert DB modules to extensionsMarko Kreen
Keep installing old module files under contrib/ still.
2012-05-10Group-access roles for SQL functions (draft)Marko Kreen
This is attempt for fine-grained access rights for all Skytools SQL schemas. As it still needs review, the rights are not activated by default, instead following sql files are generated: newgrants_<schema>.sql - applies new rights, drop old public access oldgrants_<schema>.sql - restores old rights - public execute privilege to all functions Only thing that is active by default is creation of new groups in upgrade functions. New access roles: pgq_reader Can consume queues (source-side) pgq_writer Can write into queues (source-side / dest-side) Can use pgq_node/pgq_ext schema as regular consumer (dest-side) pgq_admin Admin operations on queues, required for CascadedWorker on dest-side. Member of pgq_reader and pgq_writer. londiste_reader Member of pgq_reader, needs additional read access to tables. (source-side) londiste_writer Member of pgq_admin, needs additional write access to tables. (dest-side)
2012-03-06Clean up SQL documentationMarko Kreen
By Hannu Krosing, applied with some fixing
2011-11-29sql upgrade cleanupMarko Kreen
- use 'structure/upgrade.sql' to generate X.upgrade.sql - add pgq_ext to upgraded schemas - move non-standard upgrade scripts to extra/ - setup_skytools: build sql files in 'build' target, not always - pgq_ext.version: bump ver to 3.0.0.1
2011-09-08pgq.upgrade_schema(): magic schema upgradeMarko Kreen
2010-11-02pgq.tune_storage: turn autovac off for queue tablesMarko Kreen
2010-09-01pgq: customizable maintenance functionsMarko Kreen
2009-09-11pgq.next_batch_custom(): extended next_batchMarko Kreen
Supports create batch of several ticks and also forced lag.
2009-04-22pgq: some cleanupsMarko Kreen
also remove silly co_name default.
2009-04-21sql/pgq: pgq.batch_retry()Marko Kreen
For use by pgq_coop.
2009-04-21pgq: Drop failed event handling.Marko Kreen
Badly designed and unused concept. If such thing is needed it's much better to handle them via actual queue.
2009-04-13Merge commit 'martin/master'Marko Kreen
2009-04-08Separated queue pause from external ticker.Martin Pihlak
2009-04-08sql/pgq: allow sub_last_tick to be NULL (pgq_coop)Marko Kreen
2009-04-08sql/pgq: pgq.get_batch_cursor()Marko Kreen
Helper function to fetch batch events using a cursor.
2009-04-02pgq: Ability to limit the number of events inserted by one TXMarko Kreen
As PgQ can split batches only on transaction boundaries, it does not tolerate huge number of events inserted by one TX. This batch adds per-queue field queue_per_tx_limit, which can be set to reasonable number and PgQ will enforce the limit, by throwing error if event counts gets larger, thus rollbacking the problematic TX. Such limit also adds possibility to survive UPDATE/DELETE statements, where the WHERE clause is missing or buggy.
2009-03-20- added pgq.set_queue_config functionMartin Pihlak
- almost usable ALTER QUEUE - simple feedback for non-show commands
2009-03-18Preparation for pgq_coop: make sub_id non-unique.Marko Kreen
To allow sharing retry events between coop consumers, the simplest way is to make then share same sub_id. So remove any assumptions from the code that sub_id is unique. This patch also fixes 2 long-standing bugs: - pgq.retry_queue had double index - pgq.subscription.batch_id did not had index As both had only minor effect on performance, they went unnoticed so long.
2009-02-13sql/pgq updateMarko Kreen
structure: - event_seq field for pgq.tick table, to store last value from event_id_seq - 'disabled' field for pgq.queue, which can disable any direct inserts to queue. inserts are allowed only if session_role = 'replica' functions: - pgq.next_batch_info() as next_batch() but returns full details - pgq.ticker(): now contains ticker logic that previously was located in python code - it uses the event_seq field in tick table to know about last sequence value - pgq.insert_event_raw() - check disabled flag - pgq.seq_getval() / pgq.seq_setval() functions for safe sequence variable manipulation - remove denytriga, now regular triggers can play the role - use OUT parameters instead of ret types - pgq.force_tick(): silently ignore the request on disabled queues - pgq.maint_retry_events(): fwd port bugfix from 2.1-stable - pgq.maint_rotate_tables(): cleanup from 2.1-stable - pgq.maint_tables_to_vacuum(): add more tables - triggers/common.c: bugfix from 2.1-stable
2008-04-30cascading work:Marko Kreen
- let AdminScript detect number of args by introspection - track event_id_seq downstream - on rename update subscribers too - slightly more fleshed out switchover
2008-04-23sql/pgq: convert pgq.get_batch_info() to use out parametersMarko Kreen
2007-10-12convert to new txid interface apperaing in 8.3Marko Kreen
2007-08-11pgq: clean up table docstringsMarko Kreen
2007-07-31allow everybody to SELECT pgq and londiste tablesMarko Kreen
2007-07-30pgq: rewrite triggers in C, thus not depending on plpython anymoreMarko Kreen
2007-07-17pgq: doc & makefile updates for reorgMarko Kreen
2007-07-17pgq: simple uninstall scriptMarko Kreen
2007-07-17pgq: rewrite insert_event() in CMarko Kreen
2007-07-16pgq: add missing indexesMarko Kreen
2007-04-16bump version, cleanup commentMarko Kreen
2007-04-16pgq: add fields for get_consumer_infoMarko Kreen
2007-04-09move tick forcing to dbMarko Kreen
2007-03-13final public releaseskytools_2_1Marko Kreen