profile
viewpoint
Marco Montagna mmontagna San Francisco, CA

levkk/pg-logical-manager 5

Manage PostgreSQL logical replication.

mmontagna/extract-phone-numbers-cc-mrjob 1

Demonstration of using Python to process the Common Crawl dataset with the mrjob framework

mmontagna/geonames_countries 1

A simple wrapper for country code and tld data.

grumpycake/wordpress-docker 0

The docker wordpress images but with some extra extensions.

mmontagna/airspace-hugo 0

Airspace theme from ThemeFisher ported to Hugo

mmontagna/amazon-redshift-udfs 0

A collection of example UDFs for Amazon Redshift.

mmontagna/botocore 0

The low-level, core functionality of boto 3.

push eventmmontagna/pgsync

Andreas Sterbenz

commit sha ebd89a8144e0a8a85fba63870d4fcfd83a715ce2

Dynamically adjust batch size and skip over blank id ranges

view details

Marco Montagna

commit sha 379905404f35e34fe140064f6175fb460243abf0

Merge pull request #14 from andreasst/andreasst/dynamic_batch_size Dynamically adjust batch size and skip over blank id ranges

view details

push time in 17 days

PR merged mmontagna/pgsync

Dynamically adjust batch size and skip over blank id ranges

Skip over blank id ranges.

Dynamically adjust the batch size in case of sparse ids.

Allow specifying starting-id on the command line, primarily for testing.

+22 -3

0 comment

2 changed files

andreasst

pr closed time in 17 days

push eventmmontagna/recipekrawler

Marco Montagna

commit sha 8a80e256aea73bee25b35b28e315074b3c7a23ca

Add readme + stashed.

view details

push time in 20 days

push eventmmontagna/recipekrawler

Marco Montagna

commit sha e30ffec5a6e082e238f8c33a9c897518f4c567ad

Commit.

view details

push time in 20 days

PullRequestReviewEvent

startedlevkk/pg-rds-params-sync

started time in a month

push eventmmontagna/pgsync

Marco Montagna

commit sha 4c5f8318e40d418b915e96a508b86df544e309e6

Add ability to override primary key.

view details

push time in a month

push eventmmontagna/pgsync

Marco Montagna

commit sha 2676c9f905d5ba4ad95ec0b6579d1bdb191a3e30

Fix

view details

push time in 2 months

push eventmmontagna/pgsync

Marco Montagna

commit sha f83dc944f7a7981025854a35520101dabc8d6d3d

Automatically cleanup old table name.

view details

push time in 2 months

push eventmmontagna/pgsync

Marco Montagna

commit sha bd64d5f30f94de75afb3e2e77ce8f35796ff7ab6

Fix

view details

push time in 2 months

push eventmmontagna/pgsync

Marco Montagna

commit sha 32d0ee5f35e129e96cdc7bbe160e388747b5fbc8

Remove comment.

view details

push time in 2 months

push eventmmontagna/pgsync

Marco Montagna

commit sha 500724aa0e95779a78a294a9d63c93cf6df7de33

Avoid "." in table name.

view details

Marco Montagna

commit sha f172913b45b534e5c9c8cd617950b5795ef31f06

Merge pull request #13 from mmontagna/fix-table-name Avoid "." in table name.

view details

push time in 2 months

PR merged mmontagna/pgsync

Avoid "." in table name.
+2 -1

0 comment

1 changed file

mmontagna

pr closed time in 2 months

PR opened mmontagna/pgsync

Avoid "." in table name.
+2 -1

0 comment

1 changed file

pr created time in 2 months

create barnchmmontagna/pgsync

branch : fix-table-name

created branch time in 2 months

push eventmmontagna/pgsync

Marco Montagna

commit sha 59106886358a918075c7ea4ec8f551661d289118

Use unlogged tables and drop table if schema doesn't match.

view details

Marco Montagna

commit sha 0e6a268217d246158e186553b236cf5e65798ff6

Merge pull request #12 from mmontagna/fix-improve-sync Use unlogged tables and drop table if schema doesn't match.

view details

push time in 2 months

create barnchmmontagna/pgsync

branch : fix-improve-sync

created branch time in 2 months

push eventmmontagna/pgsync

Marco Montagna

commit sha f469d2badecef78007339cbcd9ba5a2bdc16084c

Fix deletes.

view details

push time in 2 months

push eventmmontagna/pgsync

Marco Montagna

commit sha 233124e12903ee550346994ba1c0f61eeb7b27ba

Fix deletes.

view details

push time in 2 months

PR merged mmontagna/pgsync

no temp tables for you

You know

+14 -2

0 comment

1 changed file

levkk

pr closed time in 2 months

push eventmmontagna/pgsync

Lev Kokotov

commit sha 81298f0ff063601d9967890ba468201f47f2a599

no temp tables for you

view details

Marco Montagna

commit sha 17a9ad56db7fb2f3af9337be17ae4759c27b7113

Fixes.

view details

Marco Montagna

commit sha 6db2150511ed6865e053b299463b4144e7d2b1e9

Merge pull request #11 from mmontagna/levs Use less DDL

view details

push time in 2 months

PR merged mmontagna/pgsync

Use less DDL
+15 -2

0 comment

2 changed files

mmontagna

pr closed time in 2 months

PR opened mmontagna/pgsync

Use less DDL
+15 -2

0 comment

2 changed files

pr created time in 2 months

PR opened levkk/pgsync

Lev's no DDL fix
+15 -2

0 comment

2 changed files

pr created time in 2 months

create barnchmmontagna/pgsync

branch : levs

created branch time in 2 months

push eventmmontagna/pgsync

Marco Montagna

commit sha 00518225bf3ec8ddde3a1f21c4193c07c7756bab

Log updated rows in json.

view details

push time in 2 months

push eventmmontagna/pgsync

Marco Montagna

commit sha 5cdc056f229f7176a08e27bdda25456625518796

Use transaction to allow temporary table cleanup.

view details

Marco Montagna

commit sha b54947e4906ace976f7d7d6abc518f1464360b28

Merge pull request #9 from mmontagna/cleanup-temp-tables Use transaction to allow temporary table cleanup.

view details

push time in 2 months

PR merged mmontagna/pgsync

Use transaction to allow temporary table cleanup.

Looks like pgsync assumes it runs via a direct/new session and does not provide any ability to cleanup the temporary tables it creates. This breaks/accumulates tables if pgsync runs against a postgres bouncer (common) and the bouncer holds open long lived connections.

+21 -19

0 comment

1 changed file

mmontagna

pr closed time in 2 months

more