codingecho

日々の体験などを書いてます

Entries from 2018-01-01 to 1 year

App Engine returns 502 response

TL;DR Configure your instance resources (CPU, Memory size, etc…) properlyIf you occur errors check Stackdriver Logging I tried to run my docker image in Google App Engine as App Engine Flexible Environment. Deployed my app with gcloud app …

Compare GAE, GKE and Cloud Dataflow

Requirements for us Use REST API for receiving requestsRequests a system we are developing spike up about 50 req/sec or almost 0 req/secThe project doesn't have a developer or operator exclusivelyWe use Google Cloud Platform TL;DR We decid…

Run Apache Beam process with local dependency

If you run Cloud Dataflow pipeline with some your local package, you must create setup.py and specify --setup-file option. Assume that you have a directory structure like below and main.py depends on under the my-package packages. Dataflow…

Read data from Google Cloud Datastore without ReadFromDatastore On Google Cloud Dataflow

TL;DR Use Cloud Datastore's helper method instead of google-cloud-datastore. More Details I wanted to read data from Datastore before running an Apache Beam's pipeline that uses ReadFromDatastore from apache_beam.io.gcp.datastore.v1.datast…

What you should study and should not study

TL;DR You should study what you need nowYou should not study what you may need futureIf you think you should study either foreign language or skill, you should study skill Abstract This article assumes that you have some subjects to study …

IntelliJ IDEAを使ったGo言語のセットアップ

Go言語のlocalへのインストール方法からIntelliJ IDEAへのプロジェクトのインポートと設定について記述します。 Go言語のインストール Go言語のインストールにはgoenvを使用します。 $ git clone https://github.com/syndbg/goenv.git ~/.goenv bashを使用し…

機械学習システムのアーキテクチャ設計

アーキテクチャの考え方 Machine Learning Systemsを読みました。ここで紹介されているアプリケーションのアーキテクチャの設計方法を紹介します。 こちらの書籍ではScala, Akka, Sparkを使ってリアクティブなアプリケーションを作成していますが、ここでは…

Docker daemon cannot start on Ubuntu 16.04 Linux kernel 4.4

My Docker version is Docker CE 18.06.1. $ sudo apt list --installed | grep -i docker docker-ce/xenial,now 18.06.1~ce~3-0~ubuntu amd64 [installed] Start dockerd. $ sudo systemctl start docker I got an error in syslog and cannnot start docke…

さくらのレンタルサーバのPHPモジュールモードとCGIモードのレンダリング速度を比較

TL;DR リプレイスされ新しくなったさくらのレンタルサーバに移行した新しいさくらのレンタルサーバと、古いさくらのレンタルサーバを使ってWordPressのレンダリング速度を比較した新しいさくらのレンタルサーバは古いさくらのレンタルサーバに比べて約2.1倍…

A DSP implementation for studying depends on RTB v2.3

This repository is my implementation refers to 作りながら学ぶ広告サーバ - DSP その2. This implementation uses Scala and Akka-http. It's very simple but I made sense of the outline of DSP (Demand Side Platform).

Rotation and shear mapping of Linear algebra

I created simple examples of the rotation and shear mapping of linear algebra for understanding. My examples this repository. This visualized example was very helpful for understanding eigenvectors and eigenvalues. Rotation The rotation us…

Traveling Germany and U.K.

I traveled to Germany and U.K. from Jul 5 to Jul 27. My things Two wallets (the one is sub) Clothes (three pairs of under ware, a pair of pants, a pair of short pants, a pair of short pants for sleeping) A multiple power plug adapter A han…

Full-text search for Japanese with ngram full-text parser

TL;DR Create an index with ngram full-text parser. CREATE FULLTEXT INDEX idx_message_log ON message_log (message) WITH PARSER ngram; ngram Full-Text Parser We want to do a full-text search for searching our entire texts that exist about 15…

Building a CI for Golang test

I built a CI with Jenkins for Golang test. We run go test on a Docker container and even run Jenkins on a Docker container. Directories app ├── docker │ ├── dockerfiles # Dockerfiles for unit test │ └── test │ ├── init-db.sh # This initial…

Golangでユニットテスト書くテクニック

Goは他のフレームワークにあるような大きなアサーションツールを持っていません。Goでは testing.T オブジェクトのメソッドがテストに使われます。 T.Error(args ...interface{}) または T.Error(msg string, args interface{}) はメッセージを受け取ってテ…

Lenear algebra for machine learning

[mathjax] I've been reviewing linear algebra, Mathematics for Machine Learning: Linear Algebra on Coursera. I finished the Week 2 module. This course is easy to understand as far. And I memorize what I did in week one and week two modules.…

Proposal of CEDEC 2018

I proposed the automatic reply system for our customer support to CEDEC 2018. Last week, CEDEC 2018 committee announced proposals adoptions. My proposal was not adopted, I am afraid. The causes I thought is that I just created an automatic…

LSTMの文の理解能力

English LSTMの文の理解能力について、個人的に面白いと思ったので紹介したいと思います。今回使用した学習済みモデルはこちらの記事で紹介しています。 以下の動画は2つの質問を学習済みモデルにしたものです。A(上の質問)は課金に関する質問で、B(下の質問…

Understanding sentence with LSTM

I am going to demonstrate LSTM understand a sentence. The model I used explained this blog post. Below video gives an example classifies the two questions that A is about payment and B is about an account. Both texts are what mix these two…

LSTMを使ってテキストの多クラス分類をする

English Kerasを使ってテキスト分類をするWebアプリケーションのプロトタイプを作ってみました。このプロトタイプはカスタマーサービスで利用することを想定してカスタマーからの質問に自動で返答することを考えます。質問はいくつかのカテゴリーに属してい…

Multi-categorical text classification with LSTM

I created the prototype of a web application for customer service that uses sequence classification with Keras. This prototype's purpose is to reply the proper response of some categories to our customer are based on the questions customer…

Use Mono 2.X on Ubuntu 14.04 LTS

Unfortunately, I had to use the Mono which version is 2.X in my project. It's very old, released in 2012! So I installed it on Ubuntu 16.04 LTS from source and do make. Then the error occurred in doing make like this: ./.libs/libmini-stati…

How to install CUDA and cuDNN on Ubuntu 16.04 LTS

I've been running this machine for TensorFlow and Keras with Jupyter notebook. These are my environments: $ cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=16.04 DISTRIB_CODENAME=xenial DISTRIB_DESCRIPTION="Ubuntu 16.04.3 LTS" $ lsp…

The solution of "​<Error>: Could not successfully update network info during initialization."

iOS

What happened The error message like below happened on iOS when launching an app and crash immediately. ​<Error>: Could not successfully update network info during initialization. Before this message happened, I purchased a lot of auto-renewal su</error>…

Reproduce transactions as new transaction id when repurchasing an auto-renewable subscription

I was building an app which has auto-renewable subscriptions. When I try to resubscribe the subscription I subscribed before, then iOS shows the dialog, “You’re currently subscribed to this.”, And enqueue all of the transactions I purchase…

App receipt on iOS can exceed the upper limit of the TEXT type on InnoDB

The TEXT type's upper limit of character is 65535 characters. App receipt's size, characters, can grow beyond the upper limit of the TEXT type. Therefore, I changed the type to MEDIUMTEXT type.

AWS Quicksign doesn't have the Tokyo region yet

Athena and Quicksign are not able to connect to each other in the different regions, for instance, Tokyo and Singapore. Available regions in here. I hope Quicksign is available in Tokyo region!

The test cases for In-App Purchase on iOS

iOS

I came up to implement In-App Purchase on iOS with Unity. I looked for the test cases for In-App Purchase, however, couldn't find their cases. Therefore, I memorize the test cases I checked myself. At first, please read In-App Purchase Bes…

CoreMLを使ったGenerative Adversarial NetworkのiOS Appを作る

English page iOS上でCoreMLを使って手書き文字を生成するアプリを作成しました。 手書き文字の生成からアプリの公開までをまとめておきたいと思います。 使ったソフトウェア Xcode 9.2 (9C40b) Docker 17.09.1-ce TensorFlow docker imagesha256:1bb38d61d2…