carlsverre ( Carl Sverre )

Carl Sverre carlsverre @memsql San Francisco, CA, USA http://www.carlsverre.com

repos

gists

followers

following

carlsverre/config 15

My system configuration

carlsverre/bitr 7

A very lightweight semi-twitter clone programmed in Javascript and running on a strong dose of Node.js

carlsverre/Furback 5

The backend for our Furby based hack at CHD SF 2014

carlsverre/damn-simple-dns-proxy 4

For great justice

carlsverre/FlickrFortune 3

FlickrFortune is an innovative way of twisting together the massive power of the FlickrAPI and the often overlooked insight of fortune. It combines insightful (or humorous) quotes with Flickr images to create wallpapers on the fly.

carlsverre/asset_packager 2

JavaScript and CSS Asset Compression for Production Rails Apps

carlsverre/Bartlett 1

Bartlett Quote Engine

carlsverre/bash_achievements 1

Sorta like git achievements but for bash

carlsverre/carlsverre.github.com 1

Carlsverre's Github Page

carlsverre/clark 1

My standard library additions

issue commentfreecinc/freecinc-issues

Freecinc is down

Thanks for fixing this so quickly! :fire:

carlsverre

comment created time in a day

startedept/crdt-website

started time in 2 days

issue commentfreecinc/freecinc-issues

Freecinc is down

Oh it looks like you switched to DO. Bummer - hopefully it's something simple.

carlsverre

comment created time in 2 days

issue openedfreecinc/freecinc-issues

Freecinc is down

Seems like it's down. Another GKE issue?

created time in 2 days

issue commentmemsql/memsql-spark-connector

V3 is too slow as compared to V2

Thanks for the reply - we will investigate, repro, and get back to you soon.

DeanJain

comment created time in 2 days

issue commentmemsql/memsql-spark-connector

V3 is too slow as compared to V2

Thanks for the confirmation. Can you provide an example of how you are writing data? I assume you are using the same driver code to load data using each of the connector versions? Also please provide details on the following questions:

are you using the on duplicate key feature
which compression setting are you using
provide a list of all non-sensitive (i.e. password) memsql configuration variables for each of the driver versions

DeanJain

comment created time in 2 days

issue commentmemsql/memsql-spark-connector

V3 is too slow as compared to V2

@DeanJain thanks for the report! Can you try using the latest version of our connector (3.0.5)? We fixed a pretty big issue related to large scale ingest which may directly address this problem. If that doesn't help can you:

experiment with different compression settings
confirm whether or not you are using the on duplicate key feature

Thanks!

DeanJain

comment created time in 3 days

issue commentmemsql/memsql-spark-connector

load balancing for data ingestion is not working with multi aggregators

Commit for reference: https://github.com/memsql/memsql-spark-connector/commit/c74118dc05789d0229b2127f13a79c478effc012

DeanJain

comment created time in 5 days

issue closedmemsql/memsql-spark-connector

load balancing for data ingestion is not working with multi aggregators

even after setting right config as per doc, the ingestion load from spark connector is only going to one aggregator only from spark connector.

config set: spark.conf.set("spark.datasource.memsql.ddlEndpoint", "memsql-master.cluster.internal") spark.conf.set("spark.datasource.memsql.dmlEndpoints", "memsql-master.cluster.internal,memsql-child-1.cluster.internal:3307")

ran job multiple times and all the load infile commands are going to same aggregator.

closed time in 5 days

DeanJain

issue commentmemsql/memsql-spark-connector

load balancing for data ingestion is not working with multi aggregators

Will be fixed in the next release (should be today). Thanks for the bug report!

DeanJain

comment created time in 5 days

pull request commentmemsql/memsql-spark-connector

Bump spark-daria and spark-fast-tests versions

Thanks!

MrPowers