Skip to content
All library documents

FinRL Overview of Deep Reinforcement Learning for Automated Trading

Article FinRL

Summary

The page introduces FinRL as a framework for applying deep reinforcement learning to automated stock trading. It explains that reinforcement learning agents learn through interaction and trial and error, while deep neural networks approximate the functions used by those agents. Trading is framed as a series of dynamic choices about which assets to trade, at what prices, and in what quantities, under uncertain market conditions.

The overview describes exploration and exploitation, and presents scalability across portfolios and independence from a fixed market model as potential strengths of the approach. It notes that FinRL supports multiple reinforcement learning algorithms, benchmarks, and live trading. However, this is an introductory project page rather than a strategy evaluation: it offers no empirical performance evidence or detailed implementation guidance, and the stated advantages should not be read as proof of trading profitability. The page also cautions readers that the material is educational and not financial advice.

Key ideas

  • Reinforcement learning agents improve through repeated interaction with an environment.
  • Deep reinforcement learning uses neural networks to approximate functions for decision-making.
  • Automated trading involves choosing assets, prices, and quantities in changing market conditions.
  • FinRL provides a framework with several algorithms, benchmarks, and trading applications.
  • The overview makes broad claims about scalability and model independence but presents no performance evidence.

Tags

Full text
# index


.. Finrl Library documentation master file, created by
   sphinx-quickstart on Wed Nov 18 08:14:32 2020.
   You can adapt this file completely to your liking, but it should at least
   contain the root `toctree` directive.

:github_url: https://github.com/AI4Finance-Foundation/FinRL

Welcome to FinRL Library!
=====================================================================================================

.. meta::
   :description: FinRL is the first open source framework for financial reinforcement learning. It facilitates beginners to expose themselves to quantitative finance and to develop stock trading strategies using deep reinforcement learning. It provides fine-tuned deep reinforcement learning algorithms, including DQN, DDPG, PPO, SAC, A2C, TD3, etc.
   :keywords: finance AI, OpenAI, artificial intelligence in finance, machine learning, deep reinforcement learning, DRL, RL, neural networks, deep q network, multi agent reinforcement learning

.. image:: image/logo_transparent_background.png
   :target:  https://github.com/AI4Finance-Foundation/FinRL

**Disclaimer: Nothing herein is financial advice, and NOT a recommendation to trade real money. Please use common sense and always first consult a professional before trading or investing.**

**AI4Finance** community provides this demonstrative and educational resource, in order to efficiently automate trading. FinRL is the first open source framework for financial reinforcement learning.

.. _FinRL: https://github.com/AI4Finance-Foundation/FinRL

Reinforcement learning (RL) trains an agent to solve tasks by trial and error, while DRL uses deep neural networks as function approximators. DRL balances exploration (of uncharted territory) and exploitation (of current knowledge), and has been recognized as a competitive edge for automated trading. DRL framework is powerful in solving dynamic decision making problems by learning through interactions with an unknown environment, thus exhibiting two major advantages: portfolio scalability and market model independence. Automated trading is essentially making dynamic decisions, namely **to decide where to trade, at what price, and what quantity**, over a highly stochastic and complex stock market. Taking many complex financial factors into account, DRL trading agents build a multi-factor model and provide algorithmic trading strategies, which are difficult for human traders.

`FinRL`_ provides a framework that supports various markets, SOTA DRL algorithms, benchmarks of many quant finance tasks, live trading, etc.

.. _FinRL: https://github.com/AI4Finance-Foundation/FinRL

Join or discuss FinRL with us: `AI4Finance mailing list <https://groups.google.com/u/1/g/ai4finance>`_.

Feel free to leave us feedback: report bugs using `Github issues`_ or discuss FinRL development in the Slack Channel.

.. _Github issues: https://github.com/AI4Finance-LLC/FinRL-Library/issues

.. image:: image/join_slack.png
   :target: https://join.slack.com/t/ai4financeworkspace/shared_invite/zt-jyaottie-hHqU6TdvuhMHHAMXaLw_~w
   :width: 400
   :align: center

|

.. toctree::
   :maxdepth: 1
   :hidden:

   Home <self>


.. toctree::
   :maxdepth: 1
   :caption: Getting Started

   start/introduction
   start/first_glance
   start/three_layer
   start/installation
   start/quick_start


.. toctree::
   :maxdepth: 1
   :caption: FinRL-Meta

   finrl_meta/background
   finrl_meta/overview
   finrl_meta/Data_layer
   finrl_meta/Environment_layer
   finrl_meta/Benchmark


.. toctree::
   :maxdepth: 3
   :caption: Tutorials

   tutorial/Guide
   tutorial/Homegrown_example
   tutorial/1-Introduction
   tutorial/2-Advance
   tutorial/3-Practical
   tutorial/4-Optimization
   tutorial/5-Others


.. toctree::
   :maxdepth: 1
   :caption: Developer Guide

   developer_guide/file_architecture
   developer_guide/development_setup
   developer_guide/contributing


.. toctree::
   :maxdepth: 1
   :caption: Reference

   reference/publication
   reference/reference.md


.. toctree::
   :maxdepth: 2
   :caption: FAQ

   faq

Shown in full with attribution under the source's licence. Licence: MIT

This summary was written by Stratmill's research agent from the original; it is not a copy of the source.