<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Skews Clawed on Medium]]></title>
        <description><![CDATA[Stories by Skews Clawed on Medium]]></description>
        <link>https://medium.com/@skews-clawed.0o?source=rss-34231c116bb5------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*dmbNkD5D-u45r44go_cf0g.png</url>
            <title>Stories by Skews Clawed on Medium</title>
            <link>https://medium.com/@skews-clawed.0o?source=rss-34231c116bb5------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 04:21:35 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@skews-clawed.0o/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[How to Improve Deep Learning Forecasts for Time Series  —  Part 2]]></title>
            <link>https://medium.com/@skews-clawed.0o/how-to-improve-deep-learning-forecasts-for-time-series-part-2-e357e97c01a5?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/e357e97c01a5</guid>
            <category><![CDATA[time-series-forecasting]]></category>
            <category><![CDATA[clustering]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[forecasting]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Sat, 25 Feb 2023 00:29:28 GMT</pubDate>
            <atom:updated>2023-02-25T00:29:28.604Z</atom:updated>
            <content:encoded><![CDATA[<h4>How to Improve Deep Learning Forecasts for Time Series — Part 2</h4><h4>The code behind clustering time series data.</h4><p>In the prior post we explained how clustering of time series data works. In this post we’re going to do a deep dive into the code itself. Everything will be written in python, but most libraries have an R version. We will try to stay relatively high level but the code will have some useful resources if you’re looking for more. Without further ado, let’s dive in.</p><h4>0 — Data Creation</h4><p>To help interpretation, let’s leverage a theoretical example: we’re trying to forecast gold prices by using information from local markets around the world. First, we develop a 1000 x 10 data frame. Each row corresponds to a unique time point, in our case a day, and each column corresponds to a different gold market. All values in our data frame are prices.</p><pre>rng = pd.date_range(&#39;2000-01-01&#39;, freq=&#39;d&#39;, periods=n_rows)<br>df = pd.DataFrame(np.random.rand(n_rows, n_cols), index=rng)```# create data<br>rng = pd.date_range(&#39;2000-01-01&#39;, freq=&#39;d&#39;, periods=n_rows)<br>df = pd.DataFrame(np.random.rand(n_rows, n_cols), index=rng)<br>The above code simplifies our example dramatically. One conceptual issue is that prices always take on a value between 0 and 1, however the lessons from the code still apply.<br>With a synthetic data frame created, let’s make it dirty.<br>```# &quot;unclean&quot; data<br>df = df.apply(lambda x: make_outliers_on_col(x), axis=&#39;index&#39;)<br>df = df.apply(lambda x: make_nan_on_col(x), axis=&#39;index&#39;)```# &quot;unclean&quot; data<br>df = df.apply(lambda x: make_outliers_on_col(x), axis=&#39;index&#39;)<br>df = df.apply(lambda x: make_nan_on_col(x), axis=&#39;index&#39;)<br>The functions above randomly input 10 outliers and 10 null values into our data frame. Our resulting data frame looks something like this…<br>![image](https://miro.medium.com/fit/c/2736/1364/1*-QUomosmFvm9iJj6XkTIoA.png)Figure 1: synthetic data will missing values and outliers. Image by author<br>#### 1 — Data Cleaning<br>There are two major data cleaning steps: missing data imputation and outlier removal. Luckily, pandas has some simple built-in methods that can help us.<br>```# interpolate missing values<br>df = df.interpolate(method=&#39;spline&#39;, order=1, limit=10, limit_direction=&#39;both&#39;)```# interpolate missing values<br>df = df.interpolate(method=&#39;spline&#39;, order=1, limit=10, limit_direction=&#39;both&#39;)<br>```# interpolate outliers<br>df = df.apply(lambda x: nullify_outliers(x), axis=&#39;index&#39;)<br>df = df.interpolate(method=&#39;spline&#39;, order=1, limit=10, limit_direction=&#39;both&#39;)```# interpolate outliers<br>df = df.apply(lambda x: nullify_outliers(x), axis=&#39;index&#39;)<br>df = df.interpolate(method=&#39;spline&#39;, order=1, limit=10, limit_direction=&#39;both&#39;)<br>Our strategy here is very simple. We first impute all missing data using spline interpolation. We then replace all outliers with null values and again use spline interpolation.<br>The paper suggested a variety of missing value imputation methods, some of which include interpolation (shown above), Singular Value Decomposition (SVD) Imputation, and K-Nearest-Neighbors (KNN) Imputation.<br>If you care about speed, SVD or interpolation are your best options. KNN may provide better results, but it’s more computationally intensive.<br>At the end of this step, we will have a data frame that looks like figure 2:<br>![image](https://miro.medium.com/fit/c/2756/1350/1*DhxdmGwqsZPa70U8ZLaQ7Q.png)Figure 2: synthetic cleaned data will missing values and outliers imputed. Image by author<br>#### 2 — Clustering<br>With a clean dataset, we will now look to group gold markets that have similar characteristics. Our hypothesis is that similar markets will be more easily fit by a model, thereby leading to more accurate forecasts.<br>The most effective type of classification cited in the paper involved leveraging features about each time series. We will look at two types: time series and signal processing features.<br>```# TS-specific features<br>autocorrelation = df.apply(lambda x: acf(x, nlags=3), axis=&#39;index&#39;)<br>partial_autocorrelation = df.apply(lambda x: pacf(x, nlags=3), axis=&#39;index&#39;)```# TS-specific features<br>autocorrelation = df.apply(lambda x: acf(x, nlags=3), axis=&#39;index&#39;)<br>partial_autocorrelation = df.apply(lambda x: pacf(x, nlags=3), axis=&#39;index&#39;)<br>```# Signal-processing-specific features<br>fast_fourier_transform = df.apply(lambda x: np.fft.fft(x), axis=&#39;index&#39;)<br>variance = df.apply(lambda x: np.var(x), axis=&#39;index&#39;)```# Signal-processing-specific features<br>fast_fourier_transform = df.apply(lambda x: np.fft.fft(x), axis=&#39;index&#39;)<br>variance = df.apply(lambda x: np.var(x), axis=&#39;index&#39;)<br>From here, we can perform k-means clustering on each pair of feature sets. We’re limiting to 2 features for simplicity, however the paper cites four potential features for both groups.<br>```import numpy as np<br>from scipy.cluster.vq import kmeans2```import numpy as np<br>from scipy.cluster.vq import kmeans2<br>```# setup ts and signal features for clustering<br>features = [np.array([autocorrelation, partial_autocorrelation]),<br>            np.array([fast_fourier_transform, variance])]```# setup ts and signal features for clustering<br>features = [np.array([autocorrelation, partial_autocorrelation]),<br>            np.array([fast_fourier_transform, variance])]<br>```for f in features:<br>    # cluster<br>    out = kmeans2(f, 2)<br>    cluster_centers, labels = out```for f in features:<br>    # cluster<br>    out = kmeans2(f, 2)<br>    cluster_centers, labels = out<br>```    # ...```    # ...<br>The above code groups each of our 10 gold markets into two distinct groups, as shown below in figure 3.<br>![image](https://miro.medium.com/fit/c/2384/1146/1*H82WHHmYR4o14pC4x2s0sQ.png)Figure 3: Clusters of our time series data. Left chart uses time series features and right chart uses signal-processing features. Image by author.<br>Now that we have grouped our data into “similar” time series’, we’re ready to model each group.<br>#### 3 — Forecasting Model<br>The paper cited a bi-directional LSTM as having the best accuracy. Despite the scary name, a bidirectional LSTM is just two LSTM’s. The first is trained forward to backward with regular inputs. The second is trained backward to forward with the input vectors reversed.<br>By creating two learning structures in a single epoch, the model often converges faster and learns the structure in the data more completely.<br>However, for simplicity, we will use a basic LSTM, but the concepts can be easily applied to more complex model structures.<br>Before doing so, it’s important to note that we averaged our time series values in each cluster. Some models, such as DeepAR, fit multiple time series’ and output a single prediction. However, vanilla LSTMs require univariate data.<br>```from keras.models import Sequential<br>from keras.layers import Dense<br>from keras.layers import LSTM```from keras.models import Sequential<br>from keras.layers import Dense<br>from keras.layers import LSTM<br>```# fit basic LSTM<br>model = Sequential()<br>model.add(LSTM(4, input_shape=(1, look_back)))<br>model.add(Dense(1))<br>model.compile(loss=&#39;mean_squared_error&#39;, optimizer=&#39;adam&#39;)<br>model.fit(trainX, trainY, epochs=n_epoch, batch_size=1, verbose=2)```# fit basic LSTM<br>model = Sequential()<br>model.add(LSTM(4, input_shape=(1, look_back)))<br>model.add(Dense(1))<br>model.compile(loss=&#39;mean_squared_error&#39;, optimizer=&#39;adam&#39;)<br>model.fit(trainX, trainY, epochs=n_epoch, batch_size=1, verbose=2)<br>The above code was iteratively run on all 4 datasets and their accuracies are shown below in figure 4.<br>![image](https://miro.medium.com/fit/c/2050/1208/1*gi3YdQhFnzkiTRsye57qBA.png)Figure 4: time series forecasts for each of our clusters. Blue is original data, orange is training preds, and green is our forecast. Image by author.<br>Just by judging visually, there doesn’t appear to be much difference in our forecasts, so let’s take a look at the Root Mean Squared Error (RMSE) for each of our models.<br>![image](https://miro.medium.com/fit/c/1966/960/1*KDGKK2DRZG3Levgxl4zUrA.png)Figure 5: RMSE for each of our 4 models. Image by author.<br>Figure 5 adds a bit more granularity to our evaluation. We can see that TS features performed better than signal features on cluster 1, but worse on cluster 2. Overall, the average RMSE between cluster 1 and 2 for each group is similar.<br>Now you might be wondering why performance is so similar between groups. Well if you recall, our data generating mechanism was the same for all time series’.<br>The purpose of clustering is to pick up on systematic differences in our time series models. We can then develop a specialized model for each.<br>If the data have the same underlying data generating mechanism, clustering will not help predictive performance.<br>#### 4 — Next Steps<br>The complete code for the above walkthrough can be seen here. However, for a modeling project with real world data, it’s advisable to try more.<br>For instance, leveraging subject matter knowledge for how time series’ should be grouped can also be very informative. One example for our gold data could be to cluster time series’ at similar geographic locations. If you don’t have subject matter knowledge, here are some more ideas:<br>Cluster on more features<br>Cluster on both TS and signal-based features at the same time<br>Use more complex deep learning structures<br>Introduce static features (the paper discussed architectures for this)<br>Thanks for reading! I’ll be writing 30 more posts that bring academic research to the DS industry. Check out my comment for links to the main source for this post and some useful resources.</pre><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e357e97c01a5" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How to Improve Deep Learning Forecasts for Time Series — Part 1]]></title>
            <link>https://medium.com/@skews-clawed.0o/how-to-improve-deep-learning-forecasts-for-time-series-part-1-5178a122dd74?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/5178a122dd74</guid>
            <category><![CDATA[forecasting]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[time-series-analysis]]></category>
            <category><![CDATA[time-series-forecasting]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Sat, 25 Feb 2023 00:29:25 GMT</pubDate>
            <atom:updated>2023-02-25T00:29:25.993Z</atom:updated>
            <content:encoded><![CDATA[<h4>The theory behind clustering and its benefits.</h4><p>Clustering time series data before fitting can improve accuracy by ~33% — src.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*xkCyID4wo-4ezDuU.png" /></figure><p>Figure 1: time series clustering example. Image by author. In 2021, researchers at UCLA developed a method that can improve model fit on many different time series’. By aggregating similarly structured data and fitting a model to each group, our models can specialize. While fairly straightforward to implement, as with any other complex deep learning method, we are often computationally limited by large data sets. However, all of the methods listed have support in both R and python, so development on smaller datasets should be pretty “simple.” In this post we’ll start with a technical overview then get into the nitty gritty of why clustering improves the fit of time series forecasts. And here’s part 2. Let’s dive in…</p><h4>1 — Technical TLDR</h4><p>Effective preprocessing and clustering can improve neural network forecasting accuracy on sequential data. The paper contributes to each of the following areas: Removing outliers by leveraging LOESS and the tsclean package in R. Imputing missing data using k-nearest neighbors. Clustering using both distance and feature-based methods. Outlining neural network architectures that leverage clustered data.</p><h4>2 — But what’s actually going on?</h4><p>Our main objective is to improve the accuracy of deep learning forecasts on many related time series’ (TS’s). However, as with any forecasting model, they’re only as good as their data so in this post, we will focus mainly on the data wrangling. For explanatory purposes, let’s say we have a theoretical dataset where we observe the price of gold at different markets around the world. Each of these markets tries to trade close to the global price, however due to fluctuations in supply and demand at their location, prices can change. In figure 2 below, we see a time series for one of these markets.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/912/0*GLKZ3b2PeJ1slDcK.png" /></figure><p>Figure 2: time series of the price of gold over time — src. Image by author. Now some markets have similarities. Those closer to gold mines are less impacted by shipping costs, so they show lower volatility in supply. Conversely, areas with wealthy buyers show less fluctuation in demand. Our method will group similar time series’ together so our models can fit specialize and thereby exhibit higher accuracy.</p><h4>2.1 — Data Preprocessing</h4><p>Data preprocessing is a manual process that helps derive signal out of potentially noisy and sparse data. A common first step is to remove outliers.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*m0anFgLYJOwE-xl4.png" /></figure><p>Figure 3: IQR method where Q1 is the 1st quartile and Q3 is the 3rd quartile. Values beyond the left/right bounds are outliers. Image by author. Tons of methods exist for non-temporal outlier detection, such as the classic IQR method (figure 3) where we exclude data that are sufficiently far from the center of our distribution. However, for time series data, we must take special precautions. For instance, if there’s a strong trend, change in variance, or some other systematic change in our data over time, traditional outlier detection methods are invalidated. To combat temporal changes in our data, we propose using an R package called tsclean. Fortunately it also supports missing data imputation, so if your time series has null values, you can easily interpolate them. After this step, we will have an uninterrupted time series with outliers removed, as shown in figure 4.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/914/0*ov5hdlq0ZoUMfysM.png" /></figure><p>Figure 4: missing-imputed (red) and outlier-adjusted (blue) data — src. Image by author. If you’re curious how the method works, in short, tsclean decomposes our time series into trend, seasonal, and “the rest” components, as show below.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/250/0*LNReM7kt2TMTO6US.png" /></figure><p>Figure 5: tsclean decomposition where T is trend, S is seasonality, and R is the rest. Image by author. From here, we use the IQR outlier detection method on R_t. By looking for outliers on a stationary (detrended) component of our time series, we’re more likely to find actual outliers instead of time-dependent changes. Finally, as noted earlier, the tsclean package supports linear interpolation for data imputation. Linear interpolation simply replaces the missing values with the average of non-null points next to our missing value. Despite this functionality, the authors suggest using a different method called kNNImpute — R package. Unfortunately, kNNImpute is out of the scope of this post, however the above link provides a robust walkthrough.</p><h4>2.2 — Clustering</h4><p>Now that we have a cleaned time series, we will cluster our time series values into similar sets. The purpose of clustering is to improve accuracy of our models. By working with groups of similar data points, we are more likely to accurately fit the data.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1002/0*guLx3fDCin5jcUDk.png" /></figure><p>Figure 6: example of distance based clustering — src. Image by author. There are two broad types of clustering. The first type is called distance-based clustering. This is method simply looks to minimize the distance between data points within a cluster. The authors suggest using Dynamic Time Warping (DTW), which is a very robust and common measure of distance for sequential data. As with kNNImpute, this method is out of the scope of this post, but in short it adds constraints to the distance minimization goal to allow for more robust comparisons between sequential series’.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*KbRTjPWMFOy6Hhvv.png" /></figure><p>Figure 7: theoretical example of feature-based clustering into two groups (red and blue). Image by author. The second method is called feature-based clustering. As you’d expect, it uses features to group data points into different clusters. This can be hard to visualize, so we just created an example chart in figure 7. In the paper, two sets of features were tested. The first included time-series-specific features, such as autocorrelation, partial autocorrelation, and the holt parameter. The second set borrowed ideas from signal processing and included energy, fast Fourier transform (FFT) coefficients, and variance. By leveraging information about the data, we would hopefully see patterns consistent within groups. From there, we can fit a model to each of the groups. When run on simulated data, feature-based clustering outperformed distance-based clustering. And, of the two feature sets, signal-based features outperformed time series features.</p><h4>2.3 — Neural Network Architectures</h4><p>Now that we have cleaned our original data and developed clusters, we are ready to develop our neural network architecture and train. The paper outlines 7 architectures, some of which combined dynamic and static features. In our example of gold markets, a dynamic feature could be the weather and a static feature could be the location of the market.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*ar6K-TG5WaPqIEtD.png" /></figure><p>Figure 8: model structure that showed the best performance on clustered data. Image by author On the synthetic data tested in the paper, a simple bidirectional LSTM performed best. Surprisingly, static features in the synthetic data did not improve accuracy, however this observation is very data-dependent. For your use-case, you many want to explore other architectures that include static features. And there you have it!</p><h4>3 — Summary</h4><p>In this post we covered how to preprocess and cluster time series data. Clustering alone was cited to improve classification accuracy by ~33%. However, it’s important to note that these tests were run on synthetic data — your data could see different levels of improvement. To recap, we first preprocessed the data by removing outliers using seasonal decomposition paired with the IQR method. We then imputed missing data using K-nearest neighbors. With a clean dataset, we clustered our time series data set. The most robust method involved using signal processing features. From there, a bidirectional LSTM was the most effective method for the observed training data. Static features did not improve accuracy. There are many alternatives discussed in the paper — if you need to improve model accuracy, it may be worth exploring those options. Thanks for reading! I’ll be writing 31 more posts that bring academic research to the DS industry. Check out my comment for links to the main source for this post and some useful resources.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5178a122dd74" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Understanding Quantitative Trading C16: Temporal Fusion Transformer (Tbased strategy]]></title>
            <link>https://medium.com/@skews-clawed.0o/understanding-quantitative-trading-c16-temporal-fusion-transformer-tbased-strategy-39660afb0266?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/39660afb0266</guid>
            <category><![CDATA[quant]]></category>
            <category><![CDATA[forex-trading]]></category>
            <category><![CDATA[cryptocurrency]]></category>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[algorithmic-trading]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Sat, 25 Feb 2023 00:29:22 GMT</pubDate>
            <atom:updated>2023-02-25T00:29:22.013Z</atom:updated>
            <content:encoded><![CDATA[<h4>[UQT] C18: Temporal Fusion Transformer (TFT) based trading strategy</h4><p>Temporal fusion transformer (TFT) is a type of deep learning model that is designed for modeling long sequences of data. It is a variant of the transformer architecture, which is a type of neural network that uses self-attention mechanisms to process sequences of data. The TFT model has several key features that make it well-suited for modeling long sequences of data: Multi-scale processing: The TFT model uses multiple levels of self-attention to process the input data at different scales, which allows it to capture both short- and long-range dependencies in the data. Fusion mechanism: The TFT model uses a fusion mechanism to combine the outputs from the different levels of self-attention, which allows it to effectively integrate information from different scales. Temporal encoding: The TFT model uses a temporal encoding scheme to represent the input data, which allows it to efficiently model long sequences of data. Overall, the TFT model is a powerful and flexible tool for modeling long sequences of data, and it has been shown to achieve state-of-the-art results on a wide range of tasks, including natural language processing, machine translation, and time series prediction. Application to Stock data: One study published in 2021 used a TFT model to predict stock prices for a large number of companies listed on the NASDAQ stock exchange. The authors found that the TFT model was able to outperform several baseline models, including a long short-term memory (LSTM) model and a convolutional neural network (CNN) model, on this task. Another study published in 2020 applied a TFT model to predict stock prices for a single company, and found that the model was able to outperform a LSTM model on this task. Overall, these studies suggest that the TFT model can be a effective tool for predicting stock prices. Steps to write a python example: Collects Apple stock price data using the yfinance library. Preprocesses the data by removing missing values and normalizing it. Tokenizes the data using the TFTokenizer from the transformers library. Builds a TFT model using the TFFusionModel from the transformers library. Splits the data into train and test sets. Trains the TFT model. Makes predictions on the test set. Evaluates the model using mean absolute error.</p><pre>import matplotlib.pyplot as plt<br>import numpy as np<br>import pandas as pd<br><br>from transformers import TFTokenizer, TFFusionModel<br>from sklearn.preprocessing import MinMaxScaler<br>from sklearn.metrics import mean_absolute_error<br><br># Collect Apple stock price data<br>apple = yf.Ticker(&quot;AAPL&quot;)<br>data = apple.history(period=&quot;max&quot;)<br><br># Preprocess the data<br>data.dropna(inplace=True)<br>data = data[[&#39;Close&#39;]]<br>scaler = MinMaxScaler(feature_range=(0, 1))<br>data = scaler.fit_transform(data)<br><br># Tokenize the data using the TFTokenizer<br>tokenizer = TFTokenizer.from_pretrained(&#39;t5-small&#39;)<br>input_ids = tokenizer.encode(data.tolist(), max_length=1024)<br>input_ids = np.expand_dims(input_ids, axis=0)<br><br># Build the TFT model<br>model = TFFusionModel.from_pretrained(&#39;t5-small&#39;)<br><br># Split the data into train and test sets<br>train_size = int(len(input_ids) * 0.8)<br>train, test = input_ids[:train_size], input_ids[train_size:]<br><br># Train the TFT model<br>model.train_model(train)<br><br># Make predictions on the test set<br>predictions = model.predict(test)<br><br># Inverse transform the predictions and the test data<br>predictions = scaler.inverse_transform(predictions[0])<br>test = scaler.inverse_transform(test[0])<br><br># Plot the predictions and the test data<br>plt.plot(predictions, label=&#39;Predictions&#39;)<br>plt.plot(test, label=&#39;Test data&#39;)<br>plt.legend()<br>plt.show()<br><br># Generate a trading signal based on the predictions<br>signal = np.zeros(len(predictions))<br>for i in range(1, len(predictions)):<br>    if predictions[i] &gt; test[i-1]:<br>        signal[i] = 1<br>    else:<br>        signal[i] = -1<br><br># Plot the trading signal<br>plt.plot(signal, label=&#39;Trading signal&#39;)<br>plt.legend()<br>plt.show()```import yfinance as yf<br>import matplotlib.pyplot as plt<br>import numpy as np<br>import pandas as pd<br><br>from transformers import TFTokenizer, TFFusionModel<br>from sklearn.preprocessing import MinMaxScaler<br>from sklearn.metrics import mean_absolute_error<br><br># Collect Apple stock price data<br>apple = yf.Ticker(&quot;AAPL&quot;)<br>data = apple.history(period=&quot;max&quot;)<br><br># Preprocess the data<br>data.dropna(inplace=True)<br>data = data[[&#39;Close&#39;]]<br>scaler = MinMaxScaler(feature_range=(0, 1))<br>data = scaler.fit_transform(data)<br><br># Tokenize the data using the TFTokenizer<br>tokenizer = TFTokenizer.from_pretrained(&#39;t5-small&#39;)<br>input_ids = tokenizer.encode(data.tolist(), max_length=1024)<br>input_ids = np.expand_dims(input_ids, axis=0)<br><br># Build the TFT model<br>model = TFFusionModel.from_pretrained(&#39;t5-small&#39;)<br><br># Split the data into train and test sets<br>train_size = int(len(input_ids) * 0.8)<br>train, test = input_ids[:train_size], input_ids[train_size:]<br><br># Train the TFT model<br>model.train_model(train)<br><br># Make predictions on the test set<br>predictions = model.predict(test)<br><br># Inverse transform the predictions and the test data<br>predictions = scaler.inverse_transform(predictions[0])<br>test = scaler.inverse_transform(test[0])<br><br># Plot the predictions and the test data<br>plt.plot(predictions, label=&#39;Predictions&#39;)<br>plt.plot(test, label=&#39;Test data&#39;)<br>plt.legend()<br>plt.show()<br><br># Generate a trading signal based on the predictions<br>signal = np.zeros(len(predictions))<br>for i in range(1, len(predictions)):<br>    if predictions[i] &gt; test[i-1]:<br>        signal[i] = 1<br>    else:<br>        signal[i] = -1<br><br># Plot the trading signal<br>plt.plot(signal, label=&#39;Trading signal&#39;)<br>plt.legend()<br>plt.show()<br>Disclaimer: The content herein is for education purpose only. I do not endorse or recommend any particular investment or financial product, nor do i make any representation. It is the responsibility of the reader to conduct their own research and due diligence, and consult with a qualified financial advisor before making any investment or trading decisions.</pre><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=39660afb0266" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Innovative Papers on developments in the Deep Learning domain part 2(Artificial Intelligence)]]></title>
            <link>https://medium.com/@skews-clawed.0o/innovative-papers-on-developments-in-the-deep-learning-domain-part-2-artificial-intelligence-8fe8d5903514?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/8fe8d5903514</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[data]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Sat, 25 Feb 2023 00:29:20 GMT</pubDate>
            <atom:updated>2023-02-25T00:29:20.542Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*Iq051iGsqO_FqNTT.jpeg" /></figure><p>Photo by Conny Schneider on Unsplash Do Deep Learning Models and News Headlines Outperform Conventional Prediction Techniques on Forex Data?(arXiv) Author : Sucharita Atha, Bharath Kumar Bolla Abstract : Foreign Exchange (FOREX) is a decentralised global market for exchanging currencies. The Forex market is enormous, and it operates 24 hours a day. Along with country-specific factors, Forex trading is influenced by cross-country ties and a variety of global events. Recent pandemic scenarios such as COVID19 and local elections can also have a significant impact on market pricing. We tested and compared various predictions with external elements such as news items in this work. Additionally, we compared classical machine learning methods to deep learning algorithms. We also added sentiment features from news headlines using NLP-based word embeddings and compared the performance. Our results indicate that simple regression model like linear, SGD, and Bagged performed better than deep learning models such as LSTM and RNN for single-step forecasting like the next two hours, the next day, and seven days. Surprisingly, news articles failed to improve the predictions indicating domain-based and relevant information only adds value. Among the text vectorization techniques, Word2Vec and SentenceBERT perform better. 2. Deep Learning for Omnidirectional Vision: A Survey and New Perspectives(arXiv) Author : Hao Ai, Zidong Cao, Jinjing Zhu, Haotian Bai, Yucheng Chen, Lin Wang Abstract : Omnidirectional image (ODI) data is captured with a 360x180 field-of-view, which is much wider than the pinhole cameras and contains richer spatial information than the conventional planar images. Accordingly, omnidirectional vision has attracted booming attention due to its more advantageous performance in numerous applications, such as autonomous driving and virtual reality. In recent years, the availability of customer-level 360 cameras has made omnidirectional vision more popular, and the advance of deep learning (DL) has significantly sparked its research and applications. This paper presents a systematic and comprehensive review and analysis of the recent progress in DL methods for omnidirectional vision. Our work covers four main contents: (i) An introduction to the principle of omnidirectional imaging, the convolution methods on the ODI, and datasets to highlight the differences and difficulties compared with the 2D planar image data; (ii) A structural and hierarchical taxonomy of the DL methods for omnidirectional vision; (iii) A summarization of the latest novel learning strategies and applications; (iv) An insightful discussion of the challenges and open problems by highlighting the potential research directions to trigger more research in the community 3.Classifying Human Activities using Machine Learning and Deep Learning Techniques (arXiv) Author : Sanku Satya Uday, Satti Thanuja Pavani, T. Jaya Lakshmi, Rohit Chivukula Abstract : Human Activity Recognition (HAR) describes the machines ability to recognize human actions. Nowadays, most people on earth are health conscious, so people are more interested in tracking their daily activities using Smartphones or Smart Watches, which can help them manage their daily routines in a healthy way. With this objective, Kaggle has conducted a competition to classify 6 different human activities distinctly based on the inertial signals obtained from 30 volunteers smartphones. The main challenge in HAR is to overcome the difficulties of separating human activities based on the given data such that no two activities overlap. In this experimentation, first, Data visualization is done on expert generated features with the help of t distributed Stochastic Neighborhood Embedding followed by applying various Machine Learning techniques like Logistic Regression, Linear SVC, Kernel SVM, Decision trees to better classify the 6 distinct human activities. Moreover, Deep Learning techniques like Long Short-Term Memory (LSTM), Bi-Directional LSTM, Recurrent Neural Network (RNN), and Gated Recurrent Unit (GRU) are trained using raw time series data. Finally, metrics like Accuracy, Confusion matrix, precision and recall are used to evaluate the performance of the Machine Learning and Deep Learning models. Experiment results proved that the Linear Support Vector Classifier in machine learning and Gated Recurrent Unit in Deep Learning provided better accuracy for human activity recognition compared to other classifiers 4. ALPINE: Analog In-Memory Acceleration with Tight Processor Integration for DeepLearning(arXiv) Author : Joshua Klein, Irem Boybat, Yasir Qureshi, Martino Dazzi, Alexandre Levisse, Giovanni Ansaloni, Marina Zapater, Abu Sebastian, David Atienza Abstract : Analog in-memory computing (AIMC) cores offers significant performance and energy benefits for neural network inference with respect to digital logic (e.g., CPUs). AIMCs accelerate matrix-vector multiplications, which dominate these applications’ run-time. However, AIMC-centric platforms lack the flexibility of general-purpose systems, as they often have hard-coded data flows and can only support a limited set of processing functions. With the goal of bridging this gap in flexibility, we present a novel system architecture that tightly integrates analog in-memory computing accelerators into multi-core CPUs in general-purpose systems. We developed a powerful gem5-based full system-level simulation framework into the gem5-X simulator, ALPINE, which enables an in-depth characterization of the proposed architecture. ALPINE allows the simulation of the entire computer architecture stack from major hardware components to their interactions with the Linux OS. Within ALPINE, we have defined a custom ISA extension and a software library to facilitate the deployment of inference models. We showcase and analyze a variety of mappings of different neural network types, and demonstrate up to 20.5x/20.8x performance/energy gains with respect to a SIMD-enabled ARM CPU implementation for convolutional neural networks, multi-layer perceptrons, and recurrent neural network</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8fe8d5903514" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Deep Learning Project Proposal  —  Stanford CS230 and deeplearning.ai]]></title>
            <link>https://medium.com/@skews-clawed.0o/deep-learning-project-proposal-stanford-cs230-and-deeplearning-ai-f10552fc2c4f?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/f10552fc2c4f</guid>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[trading]]></category>
            <category><![CDATA[trading-system]]></category>
            <category><![CDATA[forex]]></category>
            <category><![CDATA[algo]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Sat, 25 Feb 2023 00:29:18 GMT</pubDate>
            <atom:updated>2023-02-25T00:29:18.367Z</atom:updated>
            <content:encoded><![CDATA[<h4>Deep Learning Project Proposal — Stanford CS230 and deeplearning.ai</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/proxy/0*e4ZqK7IDADD8KLwi" /></figure><p>Photo by Luca Bravo on Unsplash</p><h4>Online courses in machine learning</h4><p>I have been studying deep learning with Stanford’s CS230 videos and the detailed material on deeplearning.ai. Andrew Ng is a highly methodical professor, and while I went in wanting just a “wam bam, thank you m’am” approach to machine learning, I’ve found myself better off for knowing the math behind the algorithms (this is evident when I have no idea why something isn’t working the way I want it to, and I can dive into the code, do some linear algebra and correctly find my way out of the bug). There is a class project that needs to be completed by the end of the course, and I’m going to apply it to algorithmic trading. That is, using some of my day trading strategies, and seeing if I can train the bot to win the “game” using reinforcement learning using profit as points. There have been several attempts with the projects of other students over the last few years, with mixed results.</p><h4>Project Proposal</h4><p>Category — Reinforcement Learning I’ll be investigating whether or not I’ll be able to ‘gamify’ day trading in FOREX and in doing so, teach a neural network to optimize entry and exit times to maximize profitability. This is interesting because old market wisdom says that it’s easy to get in the market, but once you’re in, it’s hard to get out with profit. I’d like to see if I can identify entry and exit pairs that will result in a net profit. Challenges — Some of the challenges of the project are simple. It’s hard to predict the market. It’s been shown time and time again that it barely works in the long run, especially when you have different “general conditions” in the market, referring to the fact that a market can be generally bullish, generally bearish, or trending (sideways). I need to find a type of neural network architecture that can get into a market position, and decide to get out if conditions seem like they are against the position, vs hang on if there might be a resulting profit. I also need to consider the spread or commission inherent in trading, so that the profit must exceed the cost of making the trade and holding onto the trade. Additionally I need to find an algorithmic framework that allows me to control it with the neural network I plan to build. Dataset — I’ll be utilizing historical data for the past 5–10 years for GBP/USD and USD/MXN pairs. “Cable”, another name for GBP/USD, has high volatility and high volume, while “Dollar-Peso” being the 7th most traded pair, is a little less “up and down” and will provide a more stable pair to train on. I want to limit my dataset to the past 5 years if possible to account for the inclusion of mainstream trading algorithms, as the data from before then is much less volatile and exhibits different properties. I’ll be looking at the minutely charts to get the highest resolution, but may switch to the hourly chart if the strategy calls for it. This data will be sourced from oanda.com or forex.com depending on the broker that ends up being used. The reason being is that FOREX data is not centralized, and therefore each broker has their own historical values. An algorithm trained on one service will simply not work on another service. Proposed method or Algorithm — I propose to research into reinforcement learning algorithms but also to take a look at recurrent neural networks, this is because I may need to apply sequence information in looking at “setups”, knowing that any particular moment is good to get in depending on the previous data in the chart. Reading list — TBD Evaluation of Results — Results will be scored on percent profit, with more dollars being better than fewer. It will be considered a success if the profit is shown to be greater than a buy and hold strategy over each period the algorithm is applied to. Stay tuned for updates.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f10552fc2c4f" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Foreign Exchange Rate Prediction Using Deep Learning (ANN, LSTM & GRU)]]></title>
            <link>https://medium.com/@skews-clawed.0o/foreign-exchange-rate-prediction-using-deep-learning-ann-lstm-gru-c388854c49eb?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/c388854c49eb</guid>
            <category><![CDATA[time-series-forecasting]]></category>
            <category><![CDATA[foreign-exchange]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[time-series-analysis]]></category>
            <category><![CDATA[forex-trading]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Sat, 25 Feb 2023 00:29:15 GMT</pubDate>
            <atom:updated>2023-02-25T00:29:15.876Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="image" src="https://cdn-images-1.medium.com/max/805/0*RWXQmlqVytHuF1US.jpg" /></figure><h4>Prediction of Forex Rate (USD/INR) Using LSTM &amp; GRU</h4><p>The foreign exchange rate (Forex) market is the largest and most crucial trading market in the world followed by the credit market. The foreign exchange rate market determines the exchange rate of different currencies of the world. It involves buying, selling, and exchanging currencies at current or determined prices.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/525/0*jYgAvLVuR30SSGAt.jpeg" /></figure><p>Image Source As we can see from the above figure, the average daily trading volume of the Forex market is way too higher than other big stock exchanges in the world. Some of the nice quotes on trading are — “Trading effectively is about assessing probabilities, not certainties”. Yvan Byeajee, Paradigm Shift: How to cultivate equanimity in the face of market uncertainty “The stock market is a device for transferring money from the impatient to the patient”. Warren Buffet The ability to predict the foreign exchange rate is a valuable skill in the trading business. But the prediction of the foreign exchange rate is a highly complex time series problem. As forex prices depend on many external, political factors, its prediction is a very challenging task. “It’s not whether you’re right or wrong that’s important, but how much money you make when you’re right and how much you lose when you’re wrong”. Stanley Druckenmiller</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*PCDADO4UhCwlVfWi.jpg" /></figure><p>Deep learning models proven to be very efficient in the prediction of complex financial analytics problems. In the case of time series problems, Recurrent Neural Networks (RNNs) proven to outperform traditional Machine Learning algorithms and Artificial Neural Networks (ANNs). RNNs are the networks with loops in their architecture as shown in the below figure. This feature of RNN helps them to retain information from previous sequences or events which makes them favorable for time series problems.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/408/0*H1fnSGgOmKu0R6Ck.png" /></figure><p>Image Source In this article, we will demonstrate the application of two different variants of RNNs i.e., Long Short Term Memory (LSTM) and Gated Recurrent Unit (GRU) for prediction of the foreign exchange rate (i.e., USD/INR). For knowing more about the architecture and basic working principle of RNN and LSTM you can refer to colah’s blog and for GRU you can refer to dive into deep learning blog Firstly, we will build Artificial Neural Networks as a base model, and later, we will improve the performance in prediction by applying LSTM and GRU. The full code with the dataset demonstrated in this article is available at this repo. The article is divided in the following order:</p><h4>1. About Dataset</h4><p>The data is the heart of any machine learning or deep learning project. in this case study, we have web scraped the Foreign exchange rates of USD/INR for the time period of 26 Aug 2010 to 26 Aug 2020 i.e., 10 years from the website in.investing.com. The sample entries of the dataset are shown in below table.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/397/0*qNhpEJy61n9BZWxg.png" /></figure><h4>2. Data pre-processing</h4><p>For the time-series problem, we have to convert our first column i.e., date to index. For doing this there are two methods, in one method while reading CSV file in pandas you can specify index_col=’Date’ and =True. By specifying these two parameters, pandas preprocess your DateTime column i.e., Date during import, and set it to the index of the data frame. The second method is related to post-reading means after reading the data you can first convert the date column to DateTime and then set it to the index of data frame. The code snippet demonstrating this method is shown below.</p><p>After doing the above pre-processing, the dataset looks like below as shown in table.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/384/0*y-U_W9Umu8GUq9uA.png" /></figure><p>As per the above table, our target variable is Price which we have to predict based on Date. Sorting the dataframe Next, we will sort the pandas dataframe with respect to the Date column in ascending order. The code snippet for sorting the dataframe is shown below.</p><p>As our target variable is Price, so we will select Price column and date as index while discard all other columns present in the dataset. The below figure shows the distribution of Price from August 2010 to August 2020. As per the figure, we can observe three spikes in the dataset first one is the major spike in the year 2014, the second spike observed in early 2019 while the third one is in the late 2020s.</p><h4>3. Summary Statistics</h4><p>Next, we will explore the summary statistics of the data. As per the below table, we can observe that the average price in the dataset is 61.9025 while 50% of the price is around 64 and the maximum price in the dataset is 76.97.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/137/0*NtYYuWYq-cHACd_G.png" /></figure><p>Further, we will check the distribution of data in percentage. As we can see from below figure, the total data comprise of 10 years and 80% of it lies in the interval between 2010 to 2018.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/492/0*Zo-me2M2WKXYuzHI.png" /></figure><h4>4. Train Test Split</h4><p>As we have seen 80% of the data lies in the interval of 2010 and 2018 so we will train the model for the date range of 26 August 2010 to 26 August 2018 and rest will be used for testing purposes. The code snippet for splitting the dataset and plotting the train test data frame is shown below. As per the code, we have first selected the split date as 26–08–2020 based on which segregate training and test set.</p><p>Next, we have created the training set by selecting data points up to 26–08–2020 and test set by retaining all the data points after split date 26–08–2020. The below plot showed the visualization of train test split of dataset.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/703/0*scGxJB8MXBXC-gMW.png" /></figure><h4>5. Data Normalization</h4><p>In this step, we will normalize the dataset using a standard scaler normalization method. Standard Scaler normalization involves rescaling the distribution of values so that the mean of observed values is 0 and the standard deviation is 1. The code for normalizing the dataset is shown below.</p><p>Next, we will segregate the train and test set into X_train, X_test, y_train, and y_test.</p><h4>6. Modeling</h4><p>In this step, we will build deep learning model and fit them into dataset for making the prediction. In this case study, we will first build the Artificial Neural Network (ANN) as a base model and evaluate its performance for making its result as a benchmark for LSTM and GRU models.</p><h4>Artificial Neural Network (ANN)</h4><p>Artificial neural networks (ANNs) are biologically inspired computational networks. ANNs are generally used in supervised learning problems in which we know the target labels of the data. It consists of mainly three layers: input, hidden, and output layer. In our case, we have a single input, 12 neurons in hidden layers, and an output layer which will give the output result in terms of predicted price. We have used shallow neural network with one hidden layer for our use-case and this will be our base model. The architecture of Artificial Neural Network is outlined in the below figure.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*FMgTphIKujzz4Frw.png" /></figure><p>The code snippet of ANN model is shown below.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/519/0*fQXTlJlcdHDUVryo.png" /></figure><p>As we can see, we have 37 total parameters in our ANN model. So it is quite a lightweight model which helps in lowering down the risk of overfitting The code for compiling and fitting the model is shared in the below code snippet.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/687/0*2eHDD8SBDM2KG3E7.png" /></figure><p>Now let’s talk about some of the hyper-parameters we have used in our ANN model. loss = mean_squared_error: As it is a regression problem, we have used mean_squared_error as our loss function. The mean squared error (MSE) of an estimator measures the average of the squares of the errors i.e., the average squared difference between the predicted values by the model and actual values. The mathematical formulae for mean squared error are shown below</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/669/0*JPbmbA5fPWS1ZepO.png" /></figure><p>2. metric = rmse: For metric we have used Root Mean Square Error (RMSE) which is the square root of mean squared error. It is basically the standard deviation of the residuals (i.e., difference of predicted and actual value). Residuals are a measure of how far from the regression line data points are. 3. Early stopping: Early stopping used to stop the training process of the model once the model stops showing improvement in terms of loss. Its monitor parameter used to specify which hyper-parameter we want to monitor while training the model. in our case we are monitoring loss. As we can see from the above simulation, the model stopped training after 13 epochs as it stops showing improvement further.</p><h4>Result of ANN</h4><p>After fitting the model, we have perform model evaluation based on R2 score, RMSE and Mean Absolute error. The results are shown in below table.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/629/0*TCUsFcmtr-j0Qbaa.png" /></figure><p>As we can see from the above results, the Test R2 score is 0.943 and the Adjusted R2 score is 0.942 which is quite good as in regression problem R2 and Adjusted R2 are two important performance metrics. The more the value closer to 1, the better is the model. Test RMSE of 0.071 and Test MAE of 0.054 are also relatively smaller errors which determines that the model is fitted decent regression line over the actual price.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/721/0*TUTBWETCmO2PpL6-.png" /></figure><p>As per the above prediction plot of ANN, it is observed that the model predicts closely the actual prices in the initial observations, but after 400 observations, its predicted values become too far from the actual values. Next we will move towards more complex models in time series i.e., LSTM and see how it will perform.</p><h4>LSTM</h4><p>Long Term Short Memory (LSTM) networks are another variant of RNNs. They are capable of retaining long term dependencies among the sequence of events or data points. They were first introduced by Hochreiter &amp; Schmidhuber (1997). The major difference between RNN and LSTM is that an LSTM has an explicit memory unit which stores information relevant for learning some task. In LSTMs, the memory units retain pieces of information even when the sequences get really long. The structure of LSTM cell is shown below:</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/759/0*_DA32F6Nm-vFv-a3.png" /></figure><p>Each LSTM cell consists of three gates Forget gate, Update gate and Output gate. Forget Gate: This gate controls how much information needs to be discarded from the previous cell state depending on the new input. Update Gate: This gate makes an update to the previous the cell state by writing a new piece of information to it. Output Gate: This gate controls how much information needs to be passed on to the next LSTM layer based on the current cell state. The structure of an LSTM cell allows an LSTM network to have a smooth and uninterrupted flow of gradients while backpropagating. This flow is also called the constant error carousel. Due to this characteristic LSTMs are able to solve the problem of vanishing and exploding gradients.</p><h4>Data Pre-processing for LSTM</h4><p>Before building the LSTM model, we have to pre-process the training and test set as shown in the below code snippet.</p><p>The code for building LSTM model using keras framework is shown below.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/584/0*g2802AAbVQmZI9c7.png" /></figure><p>As we can see from the above code, we have used 50 neurons in the LSTM cell with activation function relu, kernel initializer lecun_uniform, and return sequence False. For understanding the concept of kernel initializer you can refer a good discussion on datasciencestackexchange. The code for compiling and fitting the LSTM model is shown below.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/694/0*v4Wt50kWEveDjJLM.png" /></figure><p>As we can see from above figure, the training of LSTM model stopped after 40 epochs due to early stopping.</p><h4>Result of LSTM</h4><p>The result after fitting the LSTM model is shown below.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/627/0*EhERhzI_IPc9eW92.png" /></figure><p>As we can see from the above results, the Test R2 score is 0.879 and the Adjusted R2 score is also 0.0.879 which is lower than ANN’s R2 and adjusted R2 score. Test RMSE of 0.102 and Test MAE of 0.075 are also relatively more than ANN’s RMSE and MAE. The above result of LSTM led to the conclusion that LSTM performance is lower than shallow ANN network for this particular case.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/721/0*5KPdutoStg33zjAw.png" /></figure><p>As we can see from above plot, LSTM performs well for initial observations but for later part it performs worse than ANN. Further, you can try some other combinations of hyper-parameters of LSTM to see if its performance will improve or not. So, next we will build GRU model to see if its performance will be bettern than LSTM and ANN or not.</p><h4>GRU</h4><p>Gated Recurrent Unit (GRU) and LSTM both have the characterstics to retain the long term dependency of past sequence of events. The major difference between the two is LSTMs control the exposure of memory content (cell state) while GRUs expose the entire cell state to other units in the network. The LSTM unit has a separate update and forget gates, while the GRU performs both of these operations together via its reset gate. The architecture of GRU is shown in below figure.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/685/0*H7QSt0qtL5BP0kA4.png" /></figure><p>The code for building GRU model using keras framework is shown below.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/518/0*Bb8CsaEPqipR4akA.png" /></figure><p>As we can see from above figure, we have build a light weight GRU model having only 7 neurons in hidden layer due to which total model parameters are only 197. The code for compiling and fitting the model is shown below.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/689/0*_B_-BpFabIzl6kOF.png" /></figure><p>As we can observe from above figure, the model stops training after 44 epochs due to early stopping.</p><h4>Result of GRU</h4><p>The result after fitting the GRU model is shown below.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/621/0*xk3fNuUpJp51Vx4q.png" /></figure><p>As we can see from the above results, the Test R2 score is 0.967 and the Adjusted R2 score is also 0.967 which is better than ANN and LSTM. Test RMSE of 0.054 and Test MAE of 0.042 are also relatively too lesser than ANN and LSTM. The above result of GRU led to the conclusion that GRU performance is way better than the shallow ANN network and LSTM network for prediction of Forex rate.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/721/0*OyOl3zGf-oprmR2i.png" /></figure><p>From the above plot, we can observe that GRU prediction is very close to actual values whereas after 400 observations its deviation from actual price is way too lower in comparison to ANN and LSTM. So from the above results, it is clear that our final model for foreign exchange rate prediction is GRU. We further do the inverse transform of predicted and actual values as we had transformed the actual values during normalization using standard scaler.</p><h4>7. Final Assessment of Model</h4><p>In this step, after inverse transforming the predicted and actual values, we finally create the pandas data frame comprising Date, Actual Price, Predicted Price, and RMSE as shown in the table below. The reason for creating this data frame is to assess the summary statistics of predicted and actual values. The summary statistics of the above dataframe is shown below. As we can see from the above stats table, the average RMSE is 0.195 which is quite lower for this kind of dataset. Further, if we compare average, 50%, and max prices of Actual Price with GRU_prediction price, we can observe a slight difference between the two which prove that the GRU model performs literally well for the prediction of Forex prices. As the model has predicted prices that are very close to actual prices, this model can be used to detect the trend of prices which can be utilized for forecasting whether to buy or sell the currency at a particular time in the future. Finally we have plotted the prediction result of final dataframe with dates on x-axis.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/703/0*Hxp0Ln7xgn_gPRTi.png" /></figure><h4>8. Conclusion</h4><p>In this article, we have explored the Forex dataset of USD/ INR currency exchange rate for the time period of 10 years. After necessary pre-processing, we have applied the ANN model as our base model, further, we have applied LSTM and GRU. Finally, after comparing the results of these three models, we found that GRU outperformed ANN and LSTM for this task and shown commendable results Further, there is much scope left for further improvement like trying different combinations of hyperparameters in LSTM and GRU for improving the performance, you can apply the Bi-directional LSTM model and check whether it can outperform GRU and lastly, you can also apply vanilla RNN and compare its performance with other variants for prediction of the foreign exchange rate. Lastly, as we know foreign exchange rate depends on different factors like Balance of Payment of the country, Government debt, inflation, interest rates, current economic condition like recession, depression or boom, current political condition, etc. So we can use these factors in addition to technical indicators which can be fed into the input of the model for prediction of the foreign exchange rate in order to make more realistic forecasting. “Deep Learning is the quality learning that ‘sticks’ with you for the rest of your life…” Michael Fullan, Joanne Quinn &amp; Joanne McEachen Originally published at <a href="https://wisdomml.com/">https://wisdomml.com</a> on August 27, 2020.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c388854c49eb" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Deep Learning for Forex Trading]]></title>
            <link>https://medium.com/@skews-clawed.0o/deep-learning-for-forex-trading-43e3ec4fb1b2?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/43e3ec4fb1b2</guid>
            <category><![CDATA[forex]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[neural-networks]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[trading]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Sat, 25 Feb 2023 00:29:13 GMT</pubDate>
            <atom:updated>2023-02-25T00:29:13.917Z</atom:updated>
            <content:encoded><![CDATA[<p>Many research papers cover the prediction of financial time series but only a small number of them speak about the application in a real trading strategy. Most of the time the research only gives the performance metrics of the model (accuracy, RMSE, …) but without trying to transform it into a profitable strategy. When we talk about financial time series, we talk about stochastic processes, meaning it deals with a lot of randomness. For this reason, it’s unrealistic to expect getting an accuracy similar to the ones obtained in many other applications of Deep Learning. So, don’t expect getting a 80% accuracy when predicting the market to go up or down for a given time horizon. Predicting Financial Time Series is known to be one of the hardest task in Machine Learning. The purpose is instead of trying to find a model that can give you a small edge when compared to a pure random guess, or to a pure Buy and Hold strategy when we speak about the stock market. There is also a lot of things to take care regarding the data processing when applying Machine Learning to Financial Time Series. If you are a beginner in this field of research or if you get good metrics from your model but poor real trading results, you can read our paper covering this subject, Financial Time Series Data Processing for Machine Learning, it can help you to understand what’s going wrong. For years now, and in collaboration with two French engineer schools, CentralSupelec and Polytechnique, Lusis AI Department is working on Financial Time Series predictions in the perspective of applicable trading strategies. In this article and the future ones, the reader will find some methods and results than can help him a lot with his own research. But because much more than in any other domain, an AI Based Trading Strategy that works can directly be transformed into money, so we will obiously never disclose the most important things enabling to reproduce our models. If you find a reproducible model with very good metrics anywhere in a paper, take care and do your own research and backtest before investing with it.</p><h4>Predicting GBPUSD intraday trend</h4><p>In this article we illustrate the application of Deep Learning to build a trading strategy. We first create and evaluate a model predicting intraday trends on GBPUSD. Then we backtest a strategy solely based on the model predictions before to make it run in real time. Dataset : GBPUSD one hour OHLC data between 04/11/2011 and 01/30/2018, so it represents 41,401 one hour OHLC bars, for about 7 years of data Training Set : 2011–2014 Validation Set : 2015 Test Set : 2016–2018 Label : Up/Down closing price N bars later, our predictor is a classifier</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*D5-ynQXwzTEcA6gl.png" /></figure><p>Training — Validation — Test Periods on 1H GBPUSD After determining the label, we need to check the proportion of Up and Down classes in the population. Finding unbalanced labels means we would need to rebalance them, or use another metric than the accuracy. Here, we found 50.3% of Up, for 49.7% of Down class, so the Accuracy is a reliable metric for evaluating our model. Here, for confidentialty reason, we will not mention the following : prediction horizon (N bars) size of the time slices used as input for the model features (raw or derivated) we use filters or any other pre-processing applied exact model hyperparameters But we will show that surprisingly, a simple model can perform well.</p><h4>The Model</h4><p>In most of the cases when we speak about Time Series predictions we first think about using LSTM or CNN 1D. Here, we wanted to evaluate a MLNN at first to be compared to the two others. But after research we have found a way to make this model accurate enough to build a trading strategy with it. The following diagram illustrates a MLNN similar to the one we use:</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*sT3FsjgEfQAwME7j.png" /></figure><p>MLNN The model output layer has two units, one for the Up and one for the Down class. It uses a softmax activation function. The loss function is a categorical cross entropy. Why do we use such multiple unit output with softmax instead of a single unit with a sigmoid activation ? The reason is that it makes easier to create generic functions for testing various models with labels having more than two classes. The simplest case is Up/Down/Neutral, but we could also have more levels of Up and Down (strong, medium, weak, …). In general we always create a set of productivity functions at first to make the variations of models easier and faster to be built and tested. This accelerates a lot the iterations. Then we can concentrate the efforts on the most important things, the model itself and its performances metrics. About the other point we can disclose, the activation function of the Dense layers is tanh, we use an adam optimizer and dropout layers for regularization. We train the model on 500 epochs with batch size of 64 then get the following results:</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/988/0*k33FyQFqlEeNXezN.png" /></figure><p>Training and Validation Loss and Accuracy The loss function has nothing to do with what we usually get in many other Deep Learning applications. Keep in mind that financial markets is a very noisy context where we can only expect to get a small edge. We can observe the loss improves slightly up to 300 epochs then starts to move up. This indicates some overfitting persists. There are several ways to fight overfitting including: Getting more data : here we only use GBPUSD, we cannot easily apply data augmentation techniques like found in images classifiers. An inverted Cat picture is still a cat, but this is not such simple for financial time series. Any small modification of data can result in very different situations, we can never make sure the label will be the same than for the original sequence. Capturing longer history or adding data from other currency pairs can help Simplifing the Model : this is often the most efficient way to fight overfitting, before to use regularization, here it’s already done Regularization : here we only kept the dropout after testing L1 and L2 regularization Early Stopping : we don’t use it for the moment as we need to capture the best metrics around a given epoch (here somewhere between 250 and 350), an not only a precise epoch like 300. As the method does not natively exists in Keras, we need to implement a custom one So here, we already did two of these approaches, and before to experiment with more data we check the accuracy and see that we make better than a random guess with 0.56 on the validation set. For some epochs the model even did better with an accuracy exceeding 0.6 but before to try getting it with an optimal early stopping, we want to check at first how a trading strategy based on this predictor behave. So we backtest it.</p><h4>Backtesting</h4><p>We backtest the model on 3 years of data that were not used for training, so between 2015 and early 2018. The strategy built from the model is very simple. We simply buy when the model predicts an Up trend and sell short when the model predicts a Down trend. In order to evaluate the pure model performance, we don’t set any stop loss or take profit. We simply close the position N bars after the entry, where N is the prediction horizon. We also don’t set any spread for the first backtest in order to get the raw metrics. All the results below are expressed in pips. To get it we use a trade size of 10,000 GBP, so each pip represent 1 USD. We start with a 10,000 USD account. Before speaking about leveraging, every backtest must first start with non-leveraged trades in order to evaluate the risk that can be taken.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*7d1CyXCLmCJepytH.png" /></figure><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*G3AX1xLUy0-ASqbL.png" /></figure><p>Just one word about the Quality Ratio metric. You will not find it in the literature as this is a proprietary formula. Find the description below extracted from the Lusis Backtest Engine documentation.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*wQb3e3nmTQU1-4mz.png" /></figure><p>Quality Ratio definition These first results seems very good. We also observe that Average Trade Win Loss is higher than the spread generally observed on GBPUSD with good brokers, that is generally below 0.8 pips. The largest losing trade observed was down by 156 pips, so 1.56% of the initial capital and the maximum drawdown is 4%. As a reference, in the trading community, it’s often recommended by major authors to not trade a strategy exceeding 30% drawdown and to never risk more than 2% per trade. Here our metrics are already below these two limits. On financial market, and especially on Forex all the weekdays are not equivalent in term of risk and behavior. So let’s check the P&amp;L per day of week.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/290/0*TqFBJD1IvaCmNlFr.png" /></figure><p>Weekday Performances Here 0 stands for Monday and 4 stands for Friday. We can easilly see that Friday is a losing day. So let’s just add a filter in the strategy itself to remove it and run the backtest again.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/944/0*aKr2ifJyYh2XeTnw.png" /></figure><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*LdwbfkNR6RxTReqg.png" /></figure><p>Here we can immediately see an improvement of the P&amp;L, the Average Trade Win Loss and the maximum drawdown went down to 3%. The Equity curve also seems smoother. The largest losing trade seems to be still quite high at 151 pips. The most basic practice to improve it consists on adding stop loss to the strategy. Some people also add take profits but many authors consider it to be an error. The best trend following strategies often make their profits of the year from only a few number of big moves. Getting out from them too early never give you any chance to take big profits. To find where to place the Stop Loss, let’s have a look at the MAE/MFE plot, they respectively stands for Maximum Adverse Excursion and Maximum Favorable Excursion. It shows the P&amp;L achieved by every winning and losing trade compared to their maximum potential loss or winning since they were opened.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*eiMY0FGNuNdSF-lo.png" /></figure><p>Here we can see that only a few trades were small winners when their MAE was below about 50 pips. So we can say that after reaching a potential 50 pips loss there is nearly no chance for a trade to recover and become a winner. But we also see that some trades that went down by more than 50 pips can partially recover their loss before to be closed. It means that such stop loss will not necessarily improve the strategy. The only way to make sure is to run a backtest.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/948/0*Va_jGUEirSqZpxR5.png" /></figure><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*05xsnajXGs_XZIfu.png" /></figure><p>The 50 pips Stop Loss does not really improve the strategy, it even reduces some of the metrics, but we also have higher QR, meaning we can get an even more “tradable” equity curve. Our Backtest Engine enables running an optimizer in order to find the best Stop Loss distance to use. Anyway, for the moment, and because the difference is not that big, we prefer evaluating a 100% pure Deep Learning approach at first. Now we add a spread of 0.8 pips and run the backtest again, without any Stop Loss.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/924/0*Tq-sNcaPoICzgp2f.png" /></figure><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*PCOEhux_6y1Evze1.png" /></figure><p>The strategy stays profitable and is not that much affected by the spread. So we decide to run it in real time with a trading platform.</p><h4>Real time Run</h4><p>Here are the real time results in pips since the begining of the year.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/840/0*n6Yfgr7WSmg46Qg4.png" /></figure><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*VwFoXy_h2kxxJts2.png" /></figure><p>The results are still quite good and the strategy is still profitable. The recent drop end of July comes from the last news on Brexit. This is a very interesting situation that gave us some ideas to test in order to improve the performances of the model.</p><h4>Conclusion and next steps</h4><p>This article covered the creation of a Deep Learning based trading strategy and how we achieved a full backtest process to make sure that beyond the performance metrics, the model can be profitable for real time trading. The next steps for us is now to : Add more data for trying improving the accuracy Apply the same model to a portfolio of instruments Work on LSTM and CNN 1D models as they are the natural choice for such time series problem Work on Hybrid approaches with multiple inputs Some of these works are already in progress. Thank you for reading. All the work in this article was performed under JupyterLab with TensorFlow/Keras. The Backtests were performed with a personal engine created by the author under MIT licence, initialy in Golang, then transformed into Python especially to be used with machine learning models coming from TensorFlow, PyTorch or Scikit-Learn. Lusis improved a lot this software by adding automated trading feature enabling to run any strategy on a production system without any modification. Currently this real time trading can work with any Broker using Lusis Trading Platform Technology.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=43e3ec4fb1b2" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Salary Negotiation: how not to set a bunch of money on fire]]></title>
            <link>https://medium.com/@skews-clawed.0o/salary-negotiation-how-not-to-set-a-bunch-of-money-on-fire-fd7246eb6524?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/fd7246eb6524</guid>
            <category><![CDATA[design]]></category>
            <category><![CDATA[tech]]></category>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[startup]]></category>
            <category><![CDATA[programming]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Fri, 24 Feb 2023 18:50:31 GMT</pubDate>
            <atom:updated>2023-02-24T18:50:31.985Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*dgOGuomgpJsh8jCU.jpeg" /></figure><p>All photos in this article are from Christopher Nolan’s Dark Knight trilogy. Because Batman. Pop quiz, hot shot. You aced the phone screen. This morning’s on-site interviews went amazing. After lunch with the team, an HR guy sits down across the table from you. He asks you, “What’s your desired salary?” What do you do? What do you do?! Whatever you do, don’t give him a number. Because once he has that number, he can set the tone for the rest of the negotiation. That number will become a ceiling — the highest offer you could possibly get from this job. And most likely, you’ll get even less. Or maybe he’ll try another angle to trick you into saying a number before he does: “What’s your current salary?” This seems like a reasonable enough question. Don’t you kinda have to answer this question? No, you don’t have to answer this question. And you shouldn’t. Employers know that basically anything above your current salary will be an improvement for you, and they’ll adjust down the offer they were planning to give you accordingly. So what’s the best way to deal with these questions? Just say, “I’m not comfortable sharing that information at this point,” then steer the discussion back to the job you’re interviewing for. And if they persist in asking you, persist in repeating this phrase until they get the idea. At some point in the process you achieve something which I describe as “Yes, if…” rather than “No, but…”. “Yes, we want to work with you, if we can come to a mutually satisfactory offer,” which is distinguished from, “No, we don’t want to work with you, but we might work with you if it turns out that you’re disgustingly cheap.” After you have agreement in principle that, “We want you to work here. What’ll it take to make that happen?” — then and only then do you start talking about money. — Patrick McKenzie Remember — you have this information. They don’t. Your current salary and your expected salary are basically the only informational advantage you have in price negotiation. And believe me, you’ll need every advantage you can get.</p><h4>The job offer negotiation process is stacked against you.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*mhoTJtdk90gbjNRN.jpeg" /></figure><p>HR people have an incredible amount of information about you at their disposal. At the very least, they have your résumé, LinkedIn, portfolio and GitHub profile, which you gave them earlier in the application process. Chances are, they’ve also checked out your social media profiles and called former employers to ask about you (and not necessarily the references you gave them). Not only do HR people benefit from a huge information asymmetry, they also hire for a living. They are professional negotiators. They have probably driven down the salary expectations of other candidates earlier that day before sitting down with you. And tomorrow, they’ll wake up and start driving down the salary expectations of candidates all over again. What do you know about them, other than the name and title they give you when introducing themselves? You don’t know how your interviewers from earlier evaluated your performance, let alone the department’s budget for hiring you. Your goal is to even the playing field as much as possible. One important way to do this is to take this real-time, in-person salary negotiation and switch it over to email. Email has two advantages: it gives you written documentation of their offers, which makes it harder for the employer to rescind them (“Oh, John didn’t have the authority to make an offer that high.”) But more importantly, it gives you space to research their numbers, and even use the offer they just gave you as leverage to secure a higher-paying offer elsewhere.</p><h4>Regardless of their offer, negotiate upward.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*DOwWSbiOcJMGTk7N.jpeg" /></figure><p>What if you’re switching from an underpaid profession like teaching to a more lucrative field like software development? The initial offer you receive from them may be for significantly more money than you or your colleagues have ever earned. You may feel like jumping out of your chair shouting, “Yes!” But keep a poker face. There is almost always room to negotiate upward. Of course, there’s also the threat that the employer will rescind the job offer if you take too long to accept it, or if you push too hard for a higher salary. Employers know that humans are hard-wired to fear downside risk more than they value upside potential. They may use your own risk aversion against you. Let’s suppress that fear-of-missing-out for a moment, and instead think practically about the incentives an employer faces when it comes to hiring. First of all, they have already poured tremendous resources into setting up all of these interviews, and in many cases flying you out to their headquarters and putting you up in a hotel. Let’s take Google as an example. Google only extends offers to about 1 in 7 of the people who advance to their on-site interviews. Think of the dozens of hours of engineers’ time spent interviewing — and the tens of thousands of dollars in airfare and hotel bills it costs — just to make one offer. If you turn down that offer, they have to go and spend that time and money all over again, trying to find another candidate who meets their standards. So if you have an offer in hand, you already have a reasonable amount of power over the situation.</p><h4>Know the market.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*bjegL43DCvObEKmo.jpeg" /></figure><p>Sure, you could find someone in your LinkedIn network who works in a similar capacity at your target employer and ask them, “How much do they pay you over at Microsoft?” That may get you one data point. But who knows, maybe that person failed to negotiate upward. Maybe they’re being underpaid and they don’t even know it. Instead of trying to triangulate a reasonable salary by asking sensitive salary questions to a bunch of people, go straight to the data. There are three main variables that matter here: location, company, and job title. In Mumbai, a US$100,000 salary buys you a life of luxury. In San Francisco? Not so much. If you are relocating for a new job, be sure to take the city’s cost of living into account. Here’s a recent breakdown of the cost of living for most major world cities. Some companies pay better than others. Netflix is famous for paying its developers well above market rates, for example. So be sure to calibrate your offer against the salaries of other people at the same company, in the same position. You can use a tool like GlassDoor for this, but there’s a much more objective way to go about doing this: search data directly from the US Department of Labor. Wait, the US government shares data about how much companies are paying their individual employees? In the case of employees who come to the US on an H1-B work visas, the answer is yes. Employers are obligated to publish these figures. And some genius put all the data into one big searchable database of more than 1.6 million salaries. You can search by company, city, and job title. It’s free, and even has charts and filtering options. Considering that non-US nationals need a visa — and thus have less bargaining power than US nationals — these salaries would probably be on the low end for people who can already legally work in the US. So make sure that whatever offer you ultimately accept at least clears these averages given its location, company, and job title.</p><h4>Stock options may prove worthless. Focus on cash.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*C7_UKwizv4HaoXby.jpeg" /></figure><p>If a company is offering you stock as part of your compensation, and it isn’t already publicly traded (with a liquid marketplace where you can sell their stock), the stock probably isn’t worth anything. Many large companies issue their employees stock options that vest over time, as an means of trying to lock you into your job. If you can profitably exercise these stock options, then sell them on the open market, great. They are in many cases almost as good as cash. But a vast majority of startups will fail, and their stock will be worth nothing. For every graffiti artist who makes $200 million off the Facebook shares he received for painting a mural, there are thousands of startup employees whose stock options are literally worthless. Even if you’re at a successful startup, tax implications may prevent you from being able to exercise your options. Uber has used this trick to basically force employees to stay with them. Through this compensation structure, they are essentially saying, “Stay with us until we IPO, and you may eventually be rich. Leave, and you’d better have a multi-million dollar line of credit so you can pay the mother of all tax bills.” Keep in mind that if an employer willingly offers you stock in their company instead of just paying you more cash, this says a lot about their own view of the company’s prospects, and how much they expect their stock to ultimately be worth. If you’re still interested in spinning the stock option wheel of fortune, here’s a database that can help you figure out how much equity you should expect on top of your diminished salary.</p><h4>Yes, a high starting salary really is worth all of this hassle.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*_20mm7Pd_ezjU6Dx.jpeg" /></figure><p>A friend of mine went back and forth with Apple for weeks over his starting salary. After six counter-offers, he finally locked in the salary that he needed so that he and his wife could afford a house in Silicon Valley. It was nearly twice Apple’s initial offer. And another friend was able to get offers from several different companies over the process of a few weeks, then play employers against one another. Even though he already knew from day one which company he ultimately wanted to work for, and kept interviewing. He then used these additional offers as leverage to maximize his starting salary at his dream job. If you have time for a long, crazy read, Haseeb Qureshi — pro poker player turned developer — wrote a detailed account of how he negotiated like crazy and pitted employers against one another, ultimately landing a $250,000 compensation package at his first developer job. “But these are outliers,” you may be thinking. “This all sounds like so much hassle, interviewing so many places, conducting so much reconnaissance. I’ve got bills to pay.” The reality is that your future raises — and to some extent your salary at subsequent jobs — all depend heavily on your starting salary at this next job. Starting out with a lower salary — like, say, most Americans who graduated from college during the Great Recession — will cast a long shadow over your life long earning potential. This is in part because pay raises are generally awarded as a percentage of your current salary. What’s the difference between a $100,000 salary and a $120,000 salary, five years out? Assuming you get a 10% raise each year (which is a conservative figure for US software development jobs): At $100k salary: 100k + 110k + 121k + 133.1k + 146.4k = $610.5k earnings At $120k salary: 120k + 132k + 145.2k + 159.7k + 175.6k = $732.5k earnings That’s right — just an extra $20k in starting salary can translate into more than $120k in total additional wages inside five years. To put this number into perspective, it’s more than most Americans spend on their entire college education. Wouldn’t you spend a few weeks searching databases and sending emails back and forth, if it meant that you could get back all that money you spent on college? Yes. Salary negotiation is worth it.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*Kt9w8GHeNNDYxuWh.jpeg" /></figure><p>I only write about programming and technology. If you follow me on Twitter I won’t waste your time. 👍</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=fd7246eb6524" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[50 Big Companies that Started with Little or No Money]]></title>
            <link>https://medium.com/@skews-clawed.0o/50-big-companies-that-started-with-little-or-no-money-d3bcf9d0179c?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/d3bcf9d0179c</guid>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[startup]]></category>
            <category><![CDATA[venture-capital]]></category>
            <category><![CDATA[entrepreneurship]]></category>
            <category><![CDATA[tech]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Fri, 24 Feb 2023 18:50:24 GMT</pubDate>
            <atom:updated>2023-02-24T18:50:24.269Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*ItrdVZTNPGjD_-Bf.jpeg" /></figure><p>Photo: Yosuke Muroya</p><h4>50 Big Companies that Started with Little or No Money</h4><p>Joseph Flaherty, Director of Content &amp; Community There’s a widespread belief among founders that venture capital is a precursor to success. It is true that VC is a common denominator of the most successful tech startups, but it isn’t a prerequisite, especially at the early stages. Entrepreneurs can prove out quite a bit with little to no capital. Capital doesn’t make funded founders any more insightful than their bootstrapped brethren. If someone can’t creatively turn $1 into $10, Why would you expect them to be able to turn $1M into $10M? To help illustrate how companies can get started without a seed round, we’ve collected over 50 examples of businesses that started with a few thousand dollars, or even just sweat equity, and went on to become exemplars of what we call “efficient entrepreneurship.” Many of these companies have subsequently earned billion-dollar valuations, some even have billions of dollars in revenue, but none started with anything greater than what would be considered a seed round. Most had far less. A large percentage of these startups raised money from VCs, but only after they had established the fact that their success would come with or without a wire transfer from an investor. Even now, many of them aren’t widely known — they are the invisible unicorns of the tech industry. So before scrambling to schedule meetings with investors, read these stories. They provide a counterbalance to the VC-centric outlook held by many founders and provide alternative ways to think about funding. Taking venture capital should be a choice, not a compulsion. These companies show the power of a countercultural approach to capital.</p><h4>Figure Something Out, Then Ask for Money</h4><p>You don’t need venture capital to get started if you can solve a real problem for customers and charge money for it. Here are three ways to think about this:</p><h4>Automate Your Workflow</h4><p>The easiest way to build a useful product is to automate some part of your daily workflow which ensures you’ve got proven demand for your product and a pre-existing funding source.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*ycB9r8L7lWLUlkGp.jpeg" /></figure><p>MailChimp: In the year 2000, co-founder/CEO Ben Chestnut was running a design consulting business and had a stream of clients who wanted email newsletters created. The only problem was that he hated designing them. So, to spare his team the tedium, he decided to build a tool that would streamline the process and MailChimp, a $400M business, was born. Lynda: In the late 1990s, Lynda Weinman was teaching web design, but the technical books she assigned to her class were bland, so she began producing training films for her students. She spent the next two decades building a content library and tech assets that had scale sufficient to entice Linkedin to pay $1.5 billion dollars to acquire the company. PluralSight: Like Lynda.com, PluralSight offers remote software training. It bootstrapped for its first nine years and now offers 6,000 courses on everything from C# to Javascript, and is an IPO candidate with a billion dollar valuation.</p><h4>Start With a Capital Efficient Product</h4><p>Instead of trying to compete with a company like Apple, these scrappy startups filled the gap left by RadioShack and built multi-million dollar businesses worthy of emulation.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*Irx_G77FsG6Mc5FW.jpeg" /></figure><p>AdaFruit Industries: Limor Fried started her DIY electronics ecommerce empire as a student at MIT by assembling DIY kits comprised of off-the-shelf parts. Fried merchandised the same building blocks found at electronics stores but also crafted quirky content that made the prospect of soldering a replica Space Invaders cabinet seem reasonable. Now, she has 85 employees and earns $33 million per year. SparkFun: Similar to AdaFruit, Nathan Seidle started Sparkfun from his dorm room by selling electronics kits and oddball components to engineers who wanted to explore exotic new sensors and systems. Now, his ecommerce empire employs 150+ and has revenues of $32 million dollars per year.</p><h4>Old Problem + Existing Business Model + New Tech = $$$</h4><p>Solving an old problem with a new technology or UX layer can be enough to build a multi-billion dollar business. Shopify: Shopify’s founders were searching for a shopping cart solution when they were setting up an ecommerce site for snowboarders. Unable to find one, they decided to scratch their own itch and built a bespoke solution on the then red-hot Ruby on Rails framework. It turned out to be a perfect solution for plenty more people, and the founders ran the business independently for six years on the revenue they generated. They ultimately raised money from VCs and later IPOed, which rewarded them with a fourteen-billion dollar valuation. Braintree Payments: Exchanging money online, without being fleeced by fraudsters, is one of the oldest problems on the web. Braintree built a better tech solution to serve as a tollbooth for buyers and sellers and survived on the proceeds of those transactions for four years before raising $69 million in two rounds of venture capital which preceded an $800 million dollar acquisition.</p><h4>Scratch Your Own Itch</h4><p>Many entrepreneurs waste their time “playing CEO,” crafting a strategy and drawing up a dream org chart for what their business might become. The best founders avoid daydreams and focus on what can be done using only the resources at their disposal.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/716/0*2zNvOHJ9bRNLLeFx.png" /></figure><p>SimpliSafe: People scoff at the idea of trying to bootstrap a hardware business, but SimpliSafe’s Chad Laurans did it. He raised a small amount of money from friends and family and then spent eight years building a self-install security business, literally soldering the first prototypes himself to save money. Eight years later, the business has hundreds of thousands of customers, hundreds of millions in revenue, and $57M in VC from Sequoia. Ipsy: Birchbox pioneered the idea of sending sample boxes of cosmetics to potential customers, but YouTube star Michelle Phan leveraged her online celebrity — 8M+ YouTube subscribers — to turn it into a phenomenon. Her audience and relationships with cosmetics brands allowed her to build a subscription box startup that generated $150M in revenue before raising $100M in VC. ShutterStock: Jon Oringer was a professional software developer and an amateur photographer. He combined this set of skills and used 30,000 photos from his personal photo library to start a stock photo service that is currently worth $2 billion dollars. His capital efficiency paid off and ultimately turned him into a truly self-made billionaire. Quizlet: While not the biggest business on this list by any stretch, Quizlet is notable in that it was founded by a precocious 15-year-old who wanted to ace his French final. By the time Quizlet raised a Series A in 2012, it had a 22-year-old CEO, 40M users and was a top 50 website in the US. Skyscanner: The company started as a bespoke spreadsheet to help its founder find the best flight prices and has since become Edinburgh’s leading tech company with 500+ employees. The company got off the ground under its own power in 2001, raised $6M in 2007, and $192M in 2016, fifteen years after launching.</p><h4>Everyone’s Money is Green</h4><p>Funding doesn’t always come millions of dollars at a time. Founders can scrape together money from grants, incubators, and angels, or even pre-sales. The savviest entrepreneurs design their business model so that they collect payment before they deliver their product, turning customers into a source of growth capital. CoolMiniOrNot: CoolMiniOrNot started out as a website where geeks could show off their ability to paint Dungeons &amp; Dragons figurines. Eventually, the site’s founders decided to design and distribute games of their own; leveraging Kickstarter as a channel. They have run 21 Kickstarter campaigns which have raised $20,644,352 million dollars of non-dilutive funding. Game on. The Wirecutter: Who says blogging doesn’t pay? Founded by a former Gizmodo editor, the Wirecutter promised more thorough and fair-minded reviews, paired that with Amazon affiliate feed, and the self-funded startup was ultimately rewarded with a $30M exit.</p><h4>Sell! Sell! Sell!</h4><p>The best source of capital is often a customer and selling has two benefits. First, you make the cash register ring immediately. Second, You quickly learn what resonates with customers and can use those insights to refine your offering.</p><figure><img alt="image" src="https://cdn-images-1.medium.com/max/582/0*vY7jYBy-4nSpFA50.jpeg" /></figure><p>Photo: Wired RXBar: When one of the entrepreneurs behind RXBar shared his ambitious business plan with his father, the paterfamilias told his founder son to stop theorizing and start pounding the pavement, “You need to shut up and sell 1,000 bars.” That advice, plus $10K in savings, proved to be worth $600M as Kellogg’s ended up gobbling up the startup. Scentsy: DNVBs are hip, but they are over-reliant on twee launch videos and Facebook ads to drive revenue. Scentsy sold candles at swap meets when they couldn’t afford to buy ads. It wasn’t glamorous, but it did give the founders a solid grounding on the messages that resonated with buyers — Now they have more than $545 million dollars a year in revenue. LootCrate: LootCrate had over 600,000 customers buying their pop culture sample packages and $100M in revenue before they raised institutional capital. Part of the reason they were so efficient is that the company started charging customers from its first weekend in existence. Klaviyo: The co-founders of Klaviyo agreed to postpone their first hire until they had a $1MM ARR. Thanks to keen product design and a tireless sales effort, the emerging email marketing platform quickly blew past that number but held off on raising capital for three years. Spanx: Shark Tank judge Sara Blakely is the most famous founder on this list, having turned a $5,000 investment into an Oprah-approved approved garment that generates $400M in revenue annually. Her fashion sense earned her a following, but her keen appreciation of the principles of capital efficiency earned Blakely a billionaire status. Tuft and Needle: Despite facing a competitor that raised 3,994,900% more capital, this mattress upstart has been able to grow to over $100M in sales using profits and just $6,000 in seed capital. Grammarly: Spell checkers have been bundled with Word and Google Docs for over a decade, but Grammarly made enough improvements that they could charge over 800 universities and hundreds of thousands of writers a monthly fee for the freedom from grammatical faux pas. After nearly ten years of spotting typos, the company took in a $110M Series A.</p><h4>Be Miserly with Marketing</h4><p>Startup marketers might not want to waste time with unmeasurable brand marketing. Efficient entrepreneurs need campaigns to be additive, immediately. ButcherBox: In a world where boxed meal kit companies are struggling on the public market, ButcherBox, the leading ecommerce provider of grass-fed beef, has thrived, earning as much as a million dollars a week by skipping expensive ad channels and developing ongoing, capital efficient relationships with influencers. Cards Against Humanity: With just $15,700 in funding from Kickstarter, the Cards Against Humanity Team built a business that grossed over $12 million dollars in its first year. They’ve also sustained their brand with a series of canny marketing stunts, selling cow poop, cutting up a Picasso, digging a big hole representing the ennui of a post-Trump America, then selling Trump “bug out” bags, and simply asking for money. These promotions aren’t cheap to run, but they make enough money to defray costs while earning a disproportionate amount of free media. GoFundMe: Viral marketing is dismissed, rightfully, when it is tacked on to a business model, but it can be a powerful driver when properly integrated into a product. Paired with hyper-efficient Conversion Rate Optimization, it can be unbeatable. The founders of GoFundMe were able to use these twin forces to bootstrap a business to the point where it was valued at ~$600M.</p><h4>Efficiency &gt; Capital</h4><p>Startups are often measured by how much money they’ve raised, but it’s more important to consider how they spend. The best entrepreneurs orient their businesses around a technology or business model that is intrinsically more effective at multiplying capital. PaintNite: The idea of combining Monet and Merlot isn’t new, but the founders of PaintNite wanted to make the model more cost-effective. While their competitors relied on a slow, expensive franchise sales model, PaintNite paired art teachers with existing bars that wanted to sell wine on weekdays and created a business that did $30 million in revenue the year before it raised venture capital. Tough Mudder: Track &amp; field entrepreneur Will Dean turned $7,000 in savings into a company with over $100 million dollars in annual revenue. The secret was pre-selling registrations to races and then using those funds as working capital to construct the electrified obstacle courses that have made Tough Mudder a global phenomenon.</p><h4>Build a Community</h4><p>Technology is important and business models matter, but assembling a group of passionate users can create a moat that is more powerful than either. 37 Signals/Basecamp: The project management toolmaker doesn’t disclose revenue but founder Jason Fried has said the company generates “tens of millions of annual profits.” They were also one of the earliest voices championing capital efficiency and their “Bootstrapped, Profitable, and Proud” series is a must-read for anyone looking for tips on how to spend every dollar wisely. Mojang: The masons behind Minecraft never raised any venture capital, employed just 50 people, and earned nearly a billion dollars in profit before selling to Microsoft. The Swedish studio never got sucked into fads like Zynga-inspired social spamming and predatory microtransactions. Minecraft grew by charging users a flat fee, resulting in a $2.5 billion dollar acquisition. Behance: Scott Belsky bootstrapped creative community Behance for five years before raising $6.5 million from Union Square Ventures and ultimately being acquired for $150 million dollars. Thrillist: Founded in 2004, newsletter/trendsetter Thrillist was built email by email until the company raised $54 million dollars in 2015. Craigslist: Craigslist parlayed an early launch in the first dot-com boom into a durable long-term advantage. Despite having only 40 employees and not substantially updating the site for decades, Craigslist is the #17 most visited site in the US and is reported to generate hundreds of millions in profits. Plenty of Fish: The dating site was founded in 2003 and didn’t change functionality or aesthetics much over the following decade. As with Craigslist, Plenty of Fish’s biggest asset was its reputation as a well-stocked pond. Ultimately, the company ended up selling for $575 million dollars.</p><h4>Fortune Favors the “Boring”</h4><p>Boring isn’t a value judgment. Many of the most impressive, successful companies that managed to grow without capital thrived by solving acute, if somewhat dull, problems and getting paid handsomely from the start. SurveyMonkey was founded in the dot-com bubble of the 90s, and though it wasn’t as disruptive as peers like Kosmo, it was more durable. It survived the dot-com crash and steadily grew into a nine-figure run rate, only raising $100 million 11 years after getting started. Protolabs does for plastic injection molding what Vistaprint does for business cards and is currently worth $1.2B. Cvent, worth $1.65B, builds event management tools and Textura, acquired for $663M, handles construction management — neither typically considered a hot or hip market. Grasshopper is a phone networking company that had 150,000 customers, over $30 million in annual revenue, but no VC on the books, and was eventually acquired by Citrix. eClinicalWorks was founded in 1999 when the mantra was “get big fast,” and many of its contemporaries crashed and burned. By focusing on excelling at the dull, yet profitable work of managing clinical data, the company survived and now employs over 4,000 workers and generates $320 million dollars in annual revenue. Zoho: 4,000 FTEs. 18M customers. $300M+ in revenue. Not bad for a bootstrapped startup taking on Oracle and Salesforce! Datto: Founded in 2007 by running up $80K in credit card debt, this data storage startup company is now valued at over a billion dollars and is the only unicorn based in Connecticut. InsideSales.com: Started in 2004 with a $10,000 investment, the AI service provider to internal sales team has grown to 570 FTEs. It waited eight years to raise its first $4M in 2012 and has raised over a quarter billion dollars to date. JetBrains: A Prague-based developer of the leading JAVA IDE and the Kotlin programming language has grown a list of 230,000 paying customers, signed up 431 of the Fortune 500, and employs 691 people — all without the benefit of venture capital. Unity became a backbone of the mobile gaming industry by focusing on all of the unsexy aspects of game development, like cross-platform compatibility and “bump mapping.” They went years without raising capital, but now have a valuation over $1.5B, and are more successful than the majority of branded game startups. GitHub took the pain out of version control and became a critical part of the tech ecosystem before raising capital. Qualtrics started as a tool to administer surveys for schools and businesses in a basement in Utah and now employs 1,000 and rakes in $100 million dollars a year, profitably. Wistia: Corporate training videos are famously lifeless, the only thing that could be more boring is a startup dedicated to hosting them. Despite a dull as dishwater market, Wistia has managed to build an 80 person team that serves 300,000 customers including Starbucks, Cirque Du Soleil, and Casper.</p><h4>You Can Always Raise Capital Later</h4><p>Putting off raising capital pays off in mind blowing ways. Wayfair: The home goods ecommerce company was profitable from its first month of operation and grew profitably for a decade until they ultimately raised a Series A — worth $165 million dollars — shortly before going public. The company is currently worth $6 billion dollars and because they suffered little dilution, the founders are worth a billion dollars each! Zip Recruiter: “We started out with humble ambitions, to bootstrap a lifestyle business,” said Co-founder/CEO Ian Siegel in an interview with Alex Konrad from Forbes. Those ambitions were met, superseded, and as the recruiting platform continued to grow the founders decided to raise a $63M series A to tackle more ambitious plans. Nerdwallet: The personal finance service that promises to help young people save money lived on a tight budget from the time it was founded in 2009 until it a raised $64M series A in 2015. The company earned a $500M valuation based on $100M+ in annual revenue, though it recently had to tighten its belt with a small layoff.</p><h4>Blessed are the Unfundable</h4><p>A benefit of starting a business outside of a startup hub is that there isn’t much VC available. This may sound like a curse, but It can be a blessing in disguise. Unable to daydream about deploying capital, entrepreneurs are forced to make their paying customers happy. Atlassian: Atlassian, based in Australia, bootstrapped its way to a $13 billion dollar market cap, but if it had easier access to funding, the team might have chased low-quality growth and gone under before they figured out how to scale efficiently. Campaign Monitor: When a company’s first round of funding looks more like proceeds from an IPO, you know you’re dealing with efficient entrepreneurs. This is the case for Campaign Monitor, a Sydney-based startup who offers superior email analytics to companies like Disney, Coca-Cola, and Buzzfeed and whose first round of funding amounted to $250 million dollars. The Trade Desk: While he had a unique view of how to power the programmatic advertising industry, founder Jeff Green started The Trade Desk late in the funding cycle for modern AdTech. This overcapitalization of the market, combined with investors getting burned by bad performers made every round of funding a struggle throughout the life of the company. Green was a consummate startup CEO, who raised only $26.4M in venture capital during the company’s first six years, and turned it into a billion-dollar business traded on the NASDAQ. Disclosure: Founder Collective is an investor in The Trade Desk. AppLovin: It is shockingly common to hear founders talk about how they couldn’t sell investors on an idea that went on to become a billion-dollar business. Before selling his company for $1.4B, AppLovin founder Adam Foroughi said, “I couldn’t find anyone to give us an investment at what I thought was a reasonable starting point valuation (maybe $4 million or $5 million) and, by the end of our first year of operations, we were profitable and doing over $1 million a month in revenue.” The rest, as they say, is history.</p><h4>Scratching the Surface</h4><p>What’s astonishing is that these 50+ stories represent just a small sample of capital efficient companies. More companies fit this mold that we don’t spend as much time on because of their age or idiosyncrasy. Mathworks and Wolfram Research are impressive companies that employ thousands, but unless you’re a Field’s Medal winner, it’s hard to replicate their success. ESRI &amp; Bose are capital efficient case studies, but stories that are almost 60 years old. Similarly, Autodesk, the leader in CAD technology, is currently worth $25B and was started with just $60K back in 1982. It is interesting to note that adjusted for inflation that $60K would be $150K, not far off the $120K Y Combinator invests in each of its companies today. Epic was founded by Judith Faulkner in 1979; the Wisconsin-based electronic medical records provider is one of the most significant bootstrapped software company operating today. Microsoft might be the most impressive bootstrapped startup of all time and has been well studied elsewhere. Valve, self-funded by founders who got rich in the early days of Microsoft’s success, benefitted from cheat code in the startup game that’s hard to share. Veeva isn’t technically bootstrapped, having raised $4M in its early days. Still, that sum is barely more than a seed round for a lot of startups these days. Likewise, CarGurus only raised a few million dollars and went on to become the best performing tech IPO of 2017 with a market cap hovering around $3B. Outcome Health has been racked by controversy over the last year, so I don’t want to hold them out as exemplars, but they did manage to bootstrap a business to hundreds of employees before raising a huge gob of venture capital. O’Reilly Media holds a legendary position in tech and has annual revenue north of $100M. They’re also affiliated with Indie.vc which maintains another great list of bootstrapped businesses. Then there is the matter of where you draw the line. Harvest has been profitable for over a decade with 50 employees, TextNow turned a little over a million dollars into a 75 employee company. If we included every company that fits this rubric the number of profiles would surely be in the hundreds, perhaps thousands!</p><h4>Don’t Design Your Business Around VC</h4><p>Startups used to figure stuff out and then ask for money. Today, they ask for money to figure things out. Outside of drug discovery or aeronautical hardware, this is usually the wrong decision. Making progress without resources is the best way to pique a VCs interest. This article isn’t meant to promote bootstrapping. Venture capital has powered nearly every major tech company from Apple to Zappos. Just remember that you don’t need a penny to get started. You don’t need permission from funders to found and scale a startup. So the next time a VC tells you they “pass,” remember these three principles: It’s possible to get a tech-enabled business off the ground with no capital. It’s feasible to scale a tech business rapidly with very little capital. It’s often in the founder’s best interest to limit the amount of capital they take. If you know of other companies that self-funded their way to an extraordinary outcome, please let us know.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d3bcf9d0179c" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Diversify your income: All my ideas for making money online]]></title>
            <link>https://medium.com/@skews-clawed.0o/diversify-your-income-all-my-ideas-for-making-money-online-13749278f307?source=rss-34231c116bb5------2</link>
            <guid isPermaLink="false">https://medium.com/p/13749278f307</guid>
            <category><![CDATA[entrepreneurship]]></category>
            <category><![CDATA[business]]></category>
            <category><![CDATA[startup]]></category>
            <category><![CDATA[business-models]]></category>
            <category><![CDATA[money]]></category>
            <dc:creator><![CDATA[Skews Clawed]]></dc:creator>
            <pubDate>Fri, 24 Feb 2023 18:50:19 GMT</pubDate>
            <atom:updated>2023-02-24T18:50:19.824Z</atom:updated>
            <content:encoded><![CDATA[<h4>You needed more income streams yesterday.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/1024/0*b3kucePFCkBlw2KH.jpeg" /></figure><p>“Many small streams will form a big river.” — Swedish proverb Most Americans have one stream of income (a job) and less than $1,000 in savings. If you’re a part of this majority, you’re one layoff away from a catastrophe. I hate to be so dramatic, but it’s quite true. Your eggs should never be in one basket. Just ask any millionaire. Regardless of whether or not you want to become a millionaire, I beg you to have multiple income streams. The worst thing you could ever do to yourself is depend on any one source for your financial livelihood. There’s just too many unknowns — too many things out of your control. Today, there’s no excuse for not diversifying your income. It’s just too easy (after some initial hard work) and fun to make money online. In this post, I give away my favorite ideas for making money online. This is by no means a definitive list. In fact, it’s a highly curated list of income streams I have tested or have thought of creating myself.</p><h4>Information Products</h4><p>Education is the second largest industry in the U.S. following healthcare, with $1.6 trillion spent annually in the U.S. alone and $5.5 trillion globally, as of 2015. Times are changing rapidly, and with it, people need and want to develop new skills to better themselves. What do you know how to do that you could teach someone else to do?</p><h4>Create a course.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*tfBqwihvK-FDxxe7.png" /></figure><p>According to a report by Degreed, nearly 85 percent of people said they learn things for work by searching online, at least once per week, and nearly 70 percent of them learn by reading blog articles weekly and asking for recommendations from peers and mentors. A course can be a big upfront investment that has a big monthly (recurring) payoff. Since launching my course in April, I’ve made nearly $10,000. Aside from making updates to the course, my only investment was the initial time I spent making the course (about three to four weeks of work because I repurposed a lot of my previous client work to make the course). And of course, I had to purchase a domain name and website hosting — both of which were a minimal investment. Course Tips and Tricks Take other people’s courses to get inspiration for things like formatting and making sure your content is better than others. Start with the content first. Open a G-Doc, and start outlining your course. Don’t worry about technology until you have your content down. Launch your course before you finish. This will put a fire under your ass to get it done. To make a course successful, you’ll need an audience and/or marketing chops to drive people to it. Learn how to make a killer landing page that evokes emotion in people and drives them to buy. You can see my course landing page as an example. Research course ideas on Udemy, Gumroad Discover and Product Hunt Course Technology Options WordPress.org + Restrict Content Pro (This is what I use for Full Stack Marketer) Podia** (The best!!) You could also use email automation software (I prefer Mailchimp) to deliver your course over a weekly drip sequence. Course Resources Free course about building online courses 38 tips to make an engaging course on the cheap part 2 Behind the scenes of a timed online course launch Everything you wanted to know about creating a $300k+ online course Everything you wanted to know about creating a $100k online course Gumroad Discover (Get ideas of the types of courses you could create)</p><h4>Create an ebook.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/130/0*aiMgiGBh2LJCxbg6.png" /></figure><p>An ebook can be educational, funny and/or super niche. Ebook Distribution Options Gumroad Amazon Your own website Ebook Tips and Tricks Get inspired. Search Gumroad Discover and Amazon Kindle Store to see what’s popular or where there’s a gap in the market. Write about what you know. You can quickly learn too and become an expert on a topic. Research and conduct interviews with experts. Have someone else (preferably multiple people) read it before you launch it. Ebook Resources Part 1: The underground world of kindle ebooks Part 2: Confessions from the scammy underground world of kindle ebooks Part 3: Confessions from the scammy underground world of kindle ebooks How to self-publish your-book through Amazon Gumroad Discover How I make $400 a month in passive income by self-publishing</p><h4>Subscriptions</h4><p>Subscription businesses are nice because it’s recurring revenue for minimal effort. Here’s three ideas for subscription businesses. Note: These will be more of a long-term (but minimal) maintenance type of thing.</p><h4>Create a Slack community.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*Tloz1ZYbSk6B8QGj.png" /></figure><p>If you create a course, a Slack community can be an easy upsell. Paul Jarvis offers a Slack community with his course. And so do I. Even if you don’t have a course, you can still create a really good Slack community. Just check out these paid Slack communities. Slack Tips and Tricks Use SlackPass to create a paid community. Get ideas for Slack communities by reviewing what’s already out there and popular. Have a plan ahead of time. Figure out how to onboard users and have a plan for engagement because if users are paying they are going to expect value. Consider making your Slack group exclusive, meaning only allowing in high-potential/value members. Charge monthly or annually. Consider not charging your early adopters to ensure the Slack group is providing value. This will prevent refunds, which are a pain. Consider hosting Ask Me Anything (AMAs) with influencers in your niche. Create a community policy about what this group is for, how members should behave, etc. What will get people kicked out? Who is your ideal member? Slack Resources A growing community of startup founders is using Slack to exchange tips The Next Big Marketing Channel: How and Why to Create a Community With Slack How to use Slack to build communities and interact with customers How to create a community using Slack How to build a community with Slack and Typeform Why Slack is the ultimate tool to build your community</p><h4>Create a network.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*rHUjQg5DshN9v2ws.png" /></figure><p>Do you have a large, influential network? Make money off of it. Here’s a few good examples of private, paid social networks. WeWork ($45/month) IVY Soho House Young Entrepreneur Council Entrepreneurs’ Organization Network Technology Options WordPress.org Ning Hellobox SocialGo Shoutem Network Resources How to network How to build your personal network from scratch How to build your network How To Create Your Own Social Network With WordPress The real way to build a social network</p><h4>Create or curate premium content.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*gBE-aFlWT40QV_s_.png" /></figure><p>If you like creating or curating good content that people value, why not charge for it? You can send weekly emails, like GoodUI, Workshop and Lets Make Apps do. Or you can create or curate content for your own membership site that you update weekly or monthly. A good example of this would be One Month. More examples Mixergy Fizzle SitePoint Tuts+ Premium Content Technology Options WordPress.org + Restrict Content Pro (This is what I use for Full Stack Marketer) WordPress.org + Memberful Email marketing software, such as Mailchimp (My preference) GetRevue is also awesome for curated email content. (I use this too) Curated.co (Revue competitor) Premium Content Resources How one woman turned her side gig into a business that earns $12,000 a month Membership website examples Build a profitable membership website 7 different membership site models 12 successful subscription sites and what they’re doing right Complete Tutorial: How to Build a Membership Site on WordPress 11 Tips and Tools for Starting a Profitable Membership Site With WordPress Premium Content Toolbox: 100+ Guides, Tips and Resources to Make Money Off Of Paid Memberships Build an Empire: 11 Side Projects to Generate Revenue for Your Business Solve people’s small problems, and they will come to you with their big problems.medium.com</p><h4>Assets</h4><p>Utilize the assets you have lying around from previous client work or former jobs. Here’s a few types of assets that people love.</p><h4>Repurpose templates.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/130/0*dG9SRxy5d_yYS4ii.png" /></figure><p>If you do a specific process consistently, it’s likely you have a template or two up your sleeve. Valuable templates can be anything from resume templates (very popular) to blog post templates. It doesn’t have to be a web design template although those are popular too. Templates Tips and Tricks Search Gumroad for “templates” to get ideas. Search Product Hunt for “template” to get ideas. Do you have any strategies or templates lying around? Then clean it up and package it nicely so you can sell it. Make multiple file types. Launch it on Product Hunt to get traction and sales. Try to get on AppSumo, Stack Social and Mighty Deals to get more sales and traction. Distribute on Gumroad so you get added traction. Create templates for popular technology providers, like HubSpot, LeadPages, Shopify and Mailchimp. Template Ideas Make a template for a popular WordPress theme provider, like Jupiter. Presentation templates Proposal Pitch deck Sales demo/pitch Calendar, organization or planner template Infographic templates Email copy templates Email design templates Job hunt templates Resume templates Cover letter templates Email templates Marketing templates Editorial calendar Buyer personas Case study Blog post templates Content map Spreadsheet templates Cap table spreadsheet Templates Selling Options Gumroad Your own website (WordPress.org) Themeforest GraphicRiver Creative Market Shopify</p><h4>Create bundles.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/130/0*SN7qasY6RMw92VYo.png" /></figure><p>An easy to make more money is by sweetening the template deal by creating a bundle of templates or premium content to accompany your templates. Bundle Tips and Tricks Launch it on Product Hunt to get traction and sales. Try to get on AppSumo, Stack Social and Mighty Deals to get more sales and traction. Distribute on Gumroad so you get added traction. Search Gumroad for “bundles” to get ideas. Search Product Hunt for “bundles” to get ideas. Create a bundle for beginners in a new industry or setting that can be difficult to navigate at first. For example, what bundle would new freelancers need to get started? What information would pose helpful to them? If you don’t want to make recurring revenue or you don’t have an audience to launch to, then consider selling your bundle to a company that would want it to give away as marquee content to its customers. For example, InVision created these UI bundles to give away to visitors for free. Bundle Selling Options Gumroad Your own website (WordPress.org) Creative Market Shopify Bundle examples Freelance Starter Kit Organization bundle Marketing bundle Job hunt bundle UI bundles Photo bundles Infographic bundles Coupons or perk directories, such as Founders Kit</p><h4>Sell your photos.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*wDXiXV0fhHcAPMhS.png" /></figure><p>Photographers, photojournalism students or people who take good pictures are perfect candidates for selling photos. Photos Tips and Tricks If you’re in college, take a photojournalism class to learn the art of taking a good photo. Rent a nice, DSLR camera from a friend or local university. If you’re not in school, find a good course on photography. Try to sell your Instagram-esque photos to companies. Tell them this is better than using stock photo sites that everyone and their competitors utilize. Sell your smartphone photos. Photo Selling Options GraphicRiver Your own website Creative Market Shutterstock Adobe Stock DepositPhotos Fotolia Can Stock 123rf Getty Images Alamy iStock Photo Shelter PhotoMoolah Twenty20 Snapwire Dreamstime Snapped4u Foap Clashot Snapcape Photos Resources This Photographer Just Made $15K In One Day On Instagram How To Make Money From Selling Your iPhone Photos Here’s How to Get Paid for the Photos on Your Smartphone How to Make Money from Your Smartphone Photography Make side money selling your Instagram photos online 37 Ways to Make Money Selling Photos The Problem with Selling Photos on Instagram 15 Places to Sell Nature Photography Online</p><h4>Sell your notes.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*KZ_On4-Wlwa1ATyP.png" /></figure><p>Take notes for books you’re reading, courses (online or offline) you’re taking, long articles you’re reading and long videos you’re watching. Basically, you can take notes and sell them for anything that teaches people how to do something. Note Selling Options Blinkist Nexus Notes Stuvia Study Soup Joosr Create your own website like Blinkist with WordPress.org + Restrict Content Pro</p><h4>Buy and sell domain names.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*3q21ddVHoZWnQ5gV.png" /></figure><p>This is relatively simple to do and can bring you loads of money if you buy the right domains. Domain Name Tips and Tricks Look for recently expired, high-traffic (pagerank) domains. Buy exact match domain names, such as business names that don’t have websites. Generate ideas by inputting popular keywords for new niches in Agile Domain Search. Domain Selling Options Flippa Sedo Ebay Godaddy Auctions Enom Domain Name Resources How to find mega profitable exact match domain names 5 tried and true tips for buying and selling domain names for profit Find profitable domain names every time Domain Flipping: Buying &amp; Selling Domains Top 7 domain flipping tactics just can’t afford to overlook Domain name sales tips List of most expensive domain names How to Sell a Domain Name at The Highest Price? 7 Tips To Get A Great Deal Selling Your Unused Domain Name Why $10,000 For A Domain Name Is Still Cheap I will share my secret formula to make big money flipping domains</p><h4>Side-Projects</h4><p>If you’re a developer, create an app in a weekend, then launch it on Product Hunt the following week. If you can’t code, partner with a programmer. Tell her you’ll market the shit out of the app if she creates it. Side-Project Resources Epic List of Side Project Ideas for Programmers How to find side project marketing idea r/SideProject Product Hunt A Guide To Personal Side Projects Make Your Side Projects Wildly Successful: Treat Them Like Experiments Ask HN: Where do you get ideas to build side-projects? All These Hacker Side Projects Earn Their Creators $1,000+ Per Month With Basically No Effort Dan’s Side Project Ideas Spotify’s Design Lead on Why Side Projects Should Be Stupid Build a Prototype Without Code: Rely on Apps, Integrations and APIs Side Project Profit Side Projectors</p><h4>Build a Mac app.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*X6ZFhRCWH0AilfpO.png" /></figure><p>Mac App Ideas Make a calendar app to replace Sunrise Make a Pomodoro Timer, like Zonebox Mac App Resources Mac App Store Marketing Guidelines The Mac App Store: With convenience comes compromise On Life In The Mac App Store How To Launch a Mac App and Become #1 Top Paid App Globally The path to getting featured by Apple Discovery on the App Store Distributing your Mac Apps 21 Ways to Get Your App Featured on the App Store Product Hunt</p><h4>Create a web app.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*GelfSPoE6NBDp5fd.png" /></figure><p>Web App Ideas An app to replace MotivApp Awesome app ideas Coming Up With Your Web Application Ideas 7 web app ideas Web app ideas Web app ideas for the growing web developer 21 Web App Ideas for Beginner Projects Product Hunt</p><h4>Create a WordPress Plugin.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*OnA7DqxvT6EY3AWx.png" /></figure><p>WordPress Plugin Tips and Tricks Scour forums to see what plugins people want. Search Gumroad Discovery and CodeCanyon for plugin inspiration. WordPress Plugin Selling Options CodeCanyon Gumroad Your own website WordPress Plugin Resources 17 Ways to Come Up with Great WordPress Plugin Ideas (Including Actionable Examples) Wordpress.org Plugins Directory How to Brainstorm New WordPress Plugin Ideas CodeCanyon (Get inspired) WordPress plugin ideas</p><h4>Program scripts.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*MW8NZb-hKP-IBwCd.png" /></figure><p>Search Fiverr to see what the most purchased scripts are or to find scripts that are missing. Script Resources What is the most useful script you’ve written for everyday life? Over 1,500 Coding Project Ideas You need to get good at making money “A wise person should have money in their head, but not in their heart.” — Jonathan Swiftmedium.com</p><h4>Business</h4><p>Create an online business to sell or to generate recurring revenue. Business Resources Selling Your Shopify Store: How One Entrepreneur Cashed Out and Made $81K What it’s like buying a $128k side-project How I Chose The Niche For My New Online Store How To Find Trending Products To Sell Online Ecommerce Trends 2016: Niche Products That Are Killing It How To Find The Best Products To Sell Online — The Ultimate Step By Step Guide How I Built an Online T-Shirt Business and Made $1,248.90 in 3 Weeks</p><h4>Dropship.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*ts3ByVL5tFZWpfKl.png" /></figure><p>Dropshipping is a supply chain management method in which the retailer does not keep goods in stock but instead transfers customer orders and shipment details to either the manufacturer, another retailer or a wholesaler, who then ships the goods directly to the customer. Dropshipping Technology Options Fulfillment by Amazon Shopify Oberlo TradeGecko Dropshipping Ideas Make a website that looks better than all the crappy, online dog stores that currently populate the front page of Google. Dropshipping Resources Guide to Dropshipping I make over $100k per month running a dropship business — AMA</p><h4>Create an ecommerce store.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*-VdZuxc0m8fLhLWk.png" /></figure><p>Scour Polyvore or Lyst — two popular shopping apps — to get ideas for products that are sold out and look easy to make. For instance, I saw on Lyst that this unicorn bracelet was sold out, and I decided to make my own unicorn bracelet, which I never got around to selling. Ecommerce Technology Options Fulfillment by Amazon Shopify TradeGecko Zazzle Lyst Polyvore Teespring Easy Product Ideas Create T-shirts on Zazzle. Get funny t-shirt inspiration on Startup Vitamins Turn your designs into products on Casetify, Zazzle or Deny Designs.</p><h4>Create a job board.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*WBArCJ1xxZjfsLXE.png" /></figure><p>Job boards are relatively easy to make, and if you drive traffic to your site, you can charge at least $249 per post, as sites like Inbound.org and Designer News do. Job Board Technology Options WordPress.org + Job Board Theme or Plugin Job Board Tips and Tricks Find a niche, like Dribbble did for designers or Inbound.org did for marketers, to focus on. Syndicate your job posts to ZipRecruiter and/or Workable to get more eyeballs on them.</p><h4>Create an agency.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*xYRdTuN7AkbnCgFR.png" /></figure><p>Lots of highly qualified people are out of work right now. Find them jobs or freelance gigs and take a cut for your “finder’s fee.” This should be easy if you more work than you can handle currently. Agency Technology Options Try Give Get Gigs. Utilize Indeed Crowd. Post on Craigslist. Announce opportunities in popular Slack groups. Use your own website. Use Cash.me, Paypal or Venmo to get paid.</p><h4>Advertising</h4><p>While I hate advertising, I have considered some of the following advertising solutions as ways to make money, but I’ve only tested native ads myself.</p><h4>Become an influencer.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*SwzBqi4gsyLuynO4.png" /></figure><p>Have a large following on Instagram, Twitter, Medium, Facebook, Reddit, Product Hunt, Youtube or Snapchat? Get paid to feature offerings you like. The more friends, fans and followers you have, the more money you can make. Influencer Advertising Resources How Influencer Marketing helped us grow from $0 to $700k+ monthly revenue. The Fast-Growing, Profitable Market For Kid “Influencer” Endorsements On Twitter, Instagram, Vine, YouTube, And Pinterest As Social Shifts To Video, Content Creators Win Power And Dollars These 4 Celebrity Influencers Can Charge $230,000 for a Single Brand Post How much do influencers get paid Confessions of a social media exec on influencer marketing: ‘We threw too much money at them’ HOW DO INSTAGRAM INFLUENCERS MAKE MONEY? Who pays influencers? What Influencers Like Michelle Phan and PewDiePie Get Paid Hashtagpaid How much money do bloggers and social media influencers make? How much do people really get paid for Instagram sponsored posts Make money on Instagram It Girl Inc.: How Much Money Social Media’s Biggest Style Stars Really Make Instabrand Tapinfluence How to get verified on Twitter How to make money on Youtube Medium Creative Exchange</p><h4>Create affiliate accounts.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*pP6tPyFBeaWel1Bi.png" /></figure><p>You’ll either need a website, email list, blog — basically an audience — to be an affiliate advertiser. Affiliate Ad Tips and Tricks Think about the offerings you use religiously. Check if it has a referral/affiliate program, and make sure to sign-up for your own unique URL. Once you have that unique URL, share it like crazy. You can share your links on a “resources” page on your site, like Smart Passive Income and Problogger. You can include links, when relevant, in your blog posts and emails as well. Make a super niche website then sprinkle affiliate ads throughout it. Ask for an affiliate code if a company doesn’t have a program listed on its website. Affiliate Ad Resources. Clickbank Commission Junction Autoresponder Madness How I Quit My Job in July 2014 and Now Make $20,000 Per Month with Affiliate Websites 12 Blog Monetization Strategies Used To Make $124,074 Per Month</p><h4>Write native ads.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/130/0*7PwoUL7TfwiBwSMR.png" /></figure><p>Native advertising or sponsored posts are simply long-form advertorials that look like a typical blog post or email. It’s like nonchalant advertising because it doesn’t look like an ad. Native ads cost a lot more than regular ads because it’s so much longer. Native Ad Resources Why Native Advertising is Hotter Than Jennifer Lawrence Medium Creative Exchange Native Advertising Syndicate Advertorials: How To Write Them &amp; Why They’re Awesome 7 Native Advertising Companies You Need to Know About Sharethrough What Do You Get For $4,500 of Native Advertising?</p><h4>Secure sponsorships.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*DWOjHgjeuI9_bfjv.png" /></figure><p>Do you have a blog, podcast or email newsletter? Get industry leaders to sponsor your project, like Really Good Emails does. Sponsorship Resources Podcast Sponsorships: The Ultimate Guide What You Really Need To Know About Getting Sponsorships for Your Podcast But First, A Word From 100 Podcasts’ Sponsors Anatomy of a podcast ad How to Score Your Very First Travel Blog Sponsorship Find a Sponsor for Your Blog Blog Sponsorships: Finding a Match Made in Heaven How To Get Advertisers Or Sponsors For Your Website 22 Ways To Find Advertisers For Your Website How To Get Paid Sponsorship For Your Blog</p><h4>Freelancing</h4><p>Join 55 million other Americans who are currently freelancing. Freelancing is great because it centers around deliverables, not hours worked, which means you can schedule it around your full-time job.</p><h4>Make websites.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*NWDNziNeDbgS6b11.png" /></figure><p>Learn how to build WordPress websites, and sell them. It’s cheap. It’s easy to do. And it can take less than 20 minutes to set up. Yet more than half of all small businesses still don’t have a website. Website Resources How I went from underemployed waitress to the top 1% of Millennials in 6 months How to Launch a Brand New Website (With a Bang!): The Ultimate Guide 100 Creative Ideas For A Website Full-Stack Marketer I charge 30k-60k for WordPress websites with a simple marketing plan.. How I do it inside (text post)</p><h4>Provide support.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/130/0*KmqtwWmuyA7HtFmn.png" /></figure><p>Make money on your own schedule. On-Demand Support Resources Codementor Udacity Project Reviewers</p><h4>Write for blogs.</h4><figure><img alt="image" src="https://cdn-images-1.medium.com/max/129/0*EcezVpOmGCapXeg4.png" /></figure><p>Make money from blogging for different publications. The larger your following and the better your writing, the more you’ll get paid. Writing Resources Problogger Job Board Inbound.org Job Board We Work Remotely Contently Freelance Writer Database Freelance Writing Job Board Freelanship Writing Gigs</p><h4>Go ahead; steal my ideas.</h4><p>I hope one — or three, four… — of these tickled your fancy because I’m so serious when I say: Diversify your income streams. If you do, you won’t have to worry about one catastrophe wiping you out someday. My name’s Lauren Holliday, and I created a course called Full-Stack Marketer.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=13749278f307" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>