profile
viewpoint
Carl Sverre carlsverre @memsql San Francisco, CA, USA http://www.carlsverre.com

carlsverre/config 15

My system configuration

carlsverre/bitr 7

A very lightweight semi-twitter clone programmed in Javascript and running on a strong dose of Node.js

carlsverre/Furback 5

The backend for our Furby based hack at CHD SF 2014

carlsverre/damn-simple-dns-proxy 4

For great justice

carlsverre/FlickrFortune 3

FlickrFortune is an innovative way of twisting together the massive power of the FlickrAPI and the often overlooked insight of fortune. It combines insightful (or humorous) quotes with Flickr images to create wallpapers on the fly.

carlsverre/asset_packager 2

JavaScript and CSS Asset Compression for Production Rails Apps

carlsverre/Bartlett 1

Bartlett Quote Engine

carlsverre/bash_achievements 1

Sorta like git achievements but for bash

carlsverre/carlsverre.github.com 1

Carlsverre's Github Page

carlsverre/clark 1

My standard library additions

issue commentfreecinc/freecinc-issues

Freecinc is down

Thanks for fixing this so quickly! :fire:

carlsverre

comment created time in a day

startedept/crdt-website

started time in 2 days

issue commentfreecinc/freecinc-issues

Freecinc is down

Oh it looks like you switched to DO. Bummer - hopefully it's something simple.

carlsverre

comment created time in 2 days

issue openedfreecinc/freecinc-issues

Freecinc is down

Seems like it's down. Another GKE issue?

created time in 2 days

issue commentmemsql/memsql-spark-connector

V3 is too slow as compared to V2

Thanks for the reply - we will investigate, repro, and get back to you soon.

DeanJain

comment created time in 2 days

issue commentmemsql/memsql-spark-connector

V3 is too slow as compared to V2

Thanks for the confirmation. Can you provide an example of how you are writing data? I assume you are using the same driver code to load data using each of the connector versions? Also please provide details on the following questions:

  • are you using the on duplicate key feature
  • which compression setting are you using
  • provide a list of all non-sensitive (i.e. password) memsql configuration variables for each of the driver versions
DeanJain

comment created time in 2 days

issue commentmemsql/memsql-spark-connector

V3 is too slow as compared to V2

@DeanJain thanks for the report! Can you try using the latest version of our connector (3.0.5)? We fixed a pretty big issue related to large scale ingest which may directly address this problem. If that doesn't help can you:

  • experiment with different compression settings
  • confirm whether or not you are using the on duplicate key feature

Thanks!

DeanJain

comment created time in 3 days

issue commentmemsql/memsql-spark-connector

load balancing for data ingestion is not working with multi aggregators

Commit for reference: https://github.com/memsql/memsql-spark-connector/commit/c74118dc05789d0229b2127f13a79c478effc012

DeanJain

comment created time in 5 days

issue closedmemsql/memsql-spark-connector

load balancing for data ingestion is not working with multi aggregators

even after setting right config as per doc, the ingestion load from spark connector is only going to one aggregator only from spark connector.

config set: spark.conf.set("spark.datasource.memsql.ddlEndpoint", "memsql-master.cluster.internal") spark.conf.set("spark.datasource.memsql.dmlEndpoints", "memsql-master.cluster.internal,memsql-child-1.cluster.internal:3307")

ran job multiple times and all the load infile commands are going to same aggregator.

closed time in 5 days

DeanJain

issue commentmemsql/memsql-spark-connector

load balancing for data ingestion is not working with multi aggregators

Will be fixed in the next release (should be today). Thanks for the bug report!

DeanJain

comment created time in 5 days

pull request commentmemsql/memsql-spark-connector

Bump spark-daria and spark-fast-tests versions

Thanks!

MrPowers

comment created time in 5 days

create barnchmemsql/memsql-spark-connector

branch : actually-loadbalance

created branch time in 8 days

startedxwmx/nb

started time in 17 days

startedgoogle/cuckoo-index

started time in 19 days

startedchjj/liburkel

started time in a month

startedkyokan/bob-wallet

started time in a month

startedhandshake-org/urkel

started time in a month

startedaws/amazon-vpc-cni-k8s

started time in a month

startedxxxserxxx/gotop

started time in a month

startedserde-rs/serde

started time in a month

starteddropbox/pb-jelly

started time in a month

startedfilecoin-project/lotus

started time in a month

startedsamyk/magspoof

started time in a month

startedgoogle/jsonnet

started time in 2 months

startedThalhammer/jwt-cpp

started time in 2 months

startedGothenburgBitFactory/taskserver

started time in 2 months

startedGothenburgBitFactory/taskwarrior

started time in 2 months

startedpelias/placeholder

started time in 2 months

startedwhosonfirst-data/whosonfirst-data

started time in 2 months

startedmikecao/umami

started time in 2 months

startedbevyengine/bevy

started time in 2 months

startedksensehq/eventnative

started time in 2 months

push eventmemsql/memsql-spark-connector

rpourzand

commit sha 1f12466e4f76602656d47370a6be5bb11f7fcfbd

deprecation notice in 2.0 branch deprecation notice

view details

rpourzand

commit sha 2fac74c215426051612b0f18fbf5445fb52a5be3

fixing formatting

view details

rpourzand

commit sha 939e2b2c3a1d9d18afa449dec74cb469651857a0

increasing font size

view details

rpourzand

commit sha 966ea8355c892ba732d681c2694ef77fb5a96473

font size change

view details

push time in 2 months

PR merged memsql/memsql-spark-connector

Deprecation notice on 2.0 branch

Adding deprecation notice to 2.0 branch

+2 -7

0 comment

1 changed file

rpourzand

pr closed time in 2 months

startedgiltene/wrk2

started time in 3 months

starteddeekerno/tyto

started time in 3 months

startedexcalidraw/excalidraw

started time in 3 months

push eventcarlsverre/config

Carl Sverre

commit sha b39b99eca9a7a3bebb95f3ed23aa4c48b4fbe56a

light/dark mode

view details

push time in 3 months

startedtoddwschneider/nyc-taxi-data

started time in 3 months

more