2017-12-19T19:08:21Z

The Flask Mega-Tutorial Part III: Web Forms

This is the third installment of the Flask Mega-Tutorial series, in which I'm going to tell you how to work with web forms.

For your reference, below is a list of the articles in this series.

Note 1: If you are looking for the legacy version of this tutorial, it's here.

Note 2: If you would like to support my work on this blog, or just don't have patience to wait for weekly articles, I am offering the complete version of this tutorial packaged as an ebook or a set of videos. For more information, visit courses.miguelgrinberg.com.

In Chapter 2 I created a simple template for the home page of the application, and used fake objects as placeholders for things I don't have yet, like users or blog posts. In this chapter I'm going to address one of the many holes I still have in this application, specifically how to accept input from users through web forms.

Web forms are one of the most basic building blocks in any web application. I will be using forms to allow users to submit blog posts, and also for logging in to the application.

Before you proceed with this chapter, make sure you have the microblog application as I left it in the previous chapter installed, and that you can run it without any errors.

The GitHub links for this chapter are: Browse, Zip, Diff.

Introduction to Flask-WTF

To handle the web forms in this application I'm going to use the Flask-WTF extension, which is a thin wrapper around the WTForms package that nicely integrates it with Flask. This is the first Flask extension that I'm presenting to you, but it is not going to be the last. Extensions are a very important part of the Flask ecosystem, as they provide solutions to problems that Flask is intentionally not opinionated about.

Flask extensions are regular Python packages that are installed with pip. You can go ahead and install Flask-WTF in your virtual environment:

(venv) $ pip install flask-wtf

Configuration

So far the application is very simple, and for that reason I did not need to worry about its configuration. But for any applications except the simplest ones, you are going to find that Flask (and possibly also the Flask extensions that you use) offer some amount of freedom in how to do things, and you need to make some decisions, which you pass to the framework as a list of configuration variables.

There are several formats for the application to specify configuration options. The most basic solution is to define your variables as keys in app.config, which uses a dictionary style to work with variables. For example, you could do something like this:

app = Flask(__name__)
app.config['SECRET_KEY'] = 'you-will-never-guess'
# ... add more variables here as needed

While the above syntax is sufficient to create configuration options for Flask, I like to enforce the principle of separation of concerns, so instead of putting my configuration in the same place where I create my application I will use a slightly more elaborate structure that allows me to keep my configuration in a separate file.

A format that I really like because it is very extensible, is to use a class to store configuration variables. To keep things nicely organized, I'm going to create the configuration class in a separate Python module. Below you can see the new configuration class for this application, stored in a config.py module in the top-level directory.

config.py: Secret key configuration

import os

class Config(object):
    SECRET_KEY = os.environ.get('SECRET_KEY') or 'you-will-never-guess'

Pretty simple, right? The configuration settings are defined as class variables inside the Config class. As the application needs more configuration items, they can be added to this class, and later if I find that I need to have more than one configuration set, I can create subclasses of it. But don't worry about this just yet.

The SECRET_KEY configuration variable that I added as the only configuration item is an important part in most Flask applications. Flask and some of its extensions use the value of the secret key as a cryptographic key, useful to generate signatures or tokens. The Flask-WTF extension uses it to protect web forms against a nasty attack called Cross-Site Request Forgery or CSRF (pronounced "seasurf"). As its name implies, the secret key is supposed to be secret, as the strength of the tokens and signatures generated with it depends on no person outside of the trusted maintainers of the application knowing it.

The value of the secret key is set as an expression with two terms, joined by the or operator. The first term looks for the value of an environment variable, also called SECRET_KEY. The second term, is just a hardcoded string. This is a pattern that you will see me repeat often for configuration variables. The idea is that a value sourced from an environment variable is preferred, but if the environment does not define the variable, then the hardcoded string is used instead. When you are developing this application, the security requirements are low, so you can just ignore this setting and let the hardcoded string be used. But when this application is deployed on a production server, I will be setting a unique and difficult to guess value in the environment, so that the server has a secure key that nobody else knows.

Now that I have a config file, I need to tell Flask to read it and apply it. That can be done right after the Flask application instance is created using the app.config.from_object() method:

app/__init__.py: Flask configuration

from flask import Flask
from config import Config

app = Flask(__name__)
app.config.from_object(Config)

from app import routes

The way I'm importing the Config class may seem confusing at first, but if you look at how the Flask class (uppercase "F") is imported from the flask package (lowercase "f") you'll notice that I'm doing the same with the configuration. The lowercase "config" is the name of the Python module config.py, and obviously the one with the uppercase "C" is the actual class.

As I mentioned above, the configuration items can be accessed with a dictionary syntax from app.config. Here you can see a quick session with the Python interpreter where I check what is the value of the secret key:

>>> from microblog import app
>>> app.config['SECRET_KEY']
'you-will-never-guess'

User Login Form

The Flask-WTF extension uses Python classes to represent web forms. A form class simply defines the fields of the form as class variables.

Once again having separation of concerns in mind, I'm going to use a new app/forms.py module to store my web form classes. To begin, let's define a user login form, which asks the user to enter a username and a password. The form will also include a "remember me" check box, and a submit button:

app/forms.py: Login form

from flask_wtf import FlaskForm
from wtforms import StringField, PasswordField, BooleanField, SubmitField
from wtforms.validators import DataRequired

class LoginForm(FlaskForm):
    username = StringField('Username', validators=[DataRequired()])
    password = PasswordField('Password', validators=[DataRequired()])
    remember_me = BooleanField('Remember Me')
    submit = SubmitField('Sign In')

Most Flask extensions use a flask_<name> naming convention for their top-level import symbol. In this case, Flask-WTF has all its symbols under flask_wtf. This is where the FlaskForm base class is imported from at the top of app/forms.py.

The four classes that represent the field types that I'm using for this form are imported directly from the WTForms package, since the Flask-WTF extension does not provide customized versions. For each field, an object is created as a class variable in the LoginForm class. Each field is given a description or label as a first argument.

The optional validators argument that you see in some of the fields is used to attach validation behaviors to fields. The DataRequired validator simply checks that the field is not submitted empty. There are many more validators available, some of which will be used in other forms.

Form Templates

The next step is to add the form to an HTML template so that it can be rendered on a web page. The good news is that the fields that are defined in the LoginForm class know how to render themselves as HTML, so this task is fairly simple. Below you can see the login template, which I'm going to store in file app/templates/login.html:

app/templates/login.html: Login form template

{% extends "base.html" %}

{% block content %}
    <h1>Sign In</h1>
    <form action="" method="post" novalidate>
        {{ form.hidden_tag() }}
        <p>
            {{ form.username.label }}<br>
            {{ form.username(size=32) }}
        </p>
        <p>
            {{ form.password.label }}<br>
            {{ form.password(size=32) }}
        </p>
        <p>{{ form.remember_me() }} {{ form.remember_me.label }}</p>
        <p>{{ form.submit() }}</p>
    </form>
{% endblock %}

For this template I'm reusing one more time the base.html template as shown in Chapter 2, through the extends template inheritance statement. I will actually do this with all the templates, to ensure a consistent layout that includes a top navigation bar across all the pages of the application.

This template expects a form object instantiated from the LoginForm class to be given as an argument, which you can see referenced as form. This argument will be sent by the login view function, which I still haven't written.

The HTML <form> element is used as a container for the web form. The action attribute of the form is used to tell the browser the URL that should be used when submitting the information the user entered in the form. When the action is set to an empty string the form is submitted to the URL that is currently in the address bar, which is the URL that rendered the form on the page. The method attribute specifies the HTTP request method that should be used when submitting the form to the server. The default is to send it with a GET request, but in almost all cases, using a POST request makes for a better user experience because requests of this type can submit the form data in the body of the request, while GET requests add the form fields to the URL, cluttering the browser address bar. The novalidate attribute is used to tell the web browser to not apply validation to the fields in this form, which effectively leaves this task to the Flask application running in the server. Using novalidate is entirely optional, but for this first form it is important that you set it because this will allow you to test server-side validation later in this chapter.

The form.hidden_tag() template argument generates a hidden field that includes a token that is used to protect the form against CSRF attacks. All you need to do to have the form protected is include this hidden field and have the SECRET_KEY variable defined in the Flask configuration. If you take care of these two things, Flask-WTF does the rest for you.

If you've written HTML web forms in the past, you may have found it odd that there are no HTML fields in this template. This is because the fields from the form object know how to render themselves as HTML. All I needed to do was to include {{ form.<field_name>.label }} where I wanted the field label, and {{ form.<field_name>() }} where I wanted the field. For fields that require additional HTML attributes, those can be passed as arguments. The username and password fields in this template take the size as an argument that will be added to the <input> HTML element as an attribute. This is how you can also attach CSS classes or IDs to form fields.

Form Views

The final step before you can see this form in the browser is to code a new view function in the application that renders the template from the previous section.

So let's write a new view function mapped to the /login URL that creates a form, and passes it to the template for rendering. This view function can also go in the app/routes.py module with the previous one:

app/routes.py: Login view function

from flask import render_template
from app import app
from app.forms import LoginForm

# ...

@app.route('/login')
def login():
    form = LoginForm()
    return render_template('login.html', title='Sign In', form=form)

What I did here is import the LoginForm class from forms.py, instantiated an object from it, and sent it down to the template. The form=form syntax may look odd, but is simply passing the form object created in the line above (and shown on the right side) to the template with the name form (shown on the left). This is all that is required to get form fields rendered.

To make it easy to access the login form, the base template can include a link to it in the navigation bar:

app/templates/base.html: Login link in navigation bar

<div>
    Microblog:
    <a href="/index">Home</a>
    <a href="/login">Login</a>
</div>

At this point you can run the application and see the form in your web browser. With the application running, type http://localhost:5000/ in the browser's address bar, and then click on the "Login" link in the top navigation bar to see the new login form. Pretty cool, right?

Login Form

Receiving Form Data

If you try to press the submit button the browser is going to display a "Method Not Allowed" error. This is because the login view function from the previous section does one half of the job so far. It can display the form on a web page, but it has no logic to process data submitted by the user yet. This is another area where Flask-WTF makes the job really easy. Here is an updated version of the view function that accepts and validates the data submitted by the user:

app/routes.py: Receiving login credentials

from flask import render_template, flash, redirect

@app.route('/login', methods=['GET', 'POST'])
def login():
    form = LoginForm()
    if form.validate_on_submit():
        flash('Login requested for user {}, remember_me={}'.format(
            form.username.data, form.remember_me.data))
        return redirect('/index')
    return render_template('login.html', title='Sign In', form=form)

The first new thing in this version is the methods argument in the route decorator. This tells Flask that this view function accepts GET and POST requests, overriding the default, which is to accept only GET requests. The HTTP protocol states that GET requests are those that return information to the client (the web browser in this case). All the requests in the application so far are of this type. POST requests are typically used when the browser submits form data to the server (in reality GET requests can also be used for this purpose, but it is not a recommended practice). The "Method Not Allowed" error that the browser showed you before, appears because the browser tried to send a POST request and the application was not configured to accept it. By providing the methods argument, you are telling Flask which request methods should be accepted.

The form.validate_on_submit() method does all the form processing work. When the browser sends the GET request to receive the web page with the form, this method is going to return False, so in that case the function skips the if statement and goes directly to render the template in the last line of the function.

When the browser sends the POST request as a result of the user pressing the submit button, form.validate_on_submit() is going to gather all the data, run all the validators attached to fields, and if everything is all right it will return True, indicating that the data is valid and can be processed by the application. But if at least one field fails validation, then the function will return False, and that will cause the form to be rendered back to the user, like in the GET request case. Later I'm going to add an error message when validation fails.

When form.validate_on_submit() returns True, the login view function calls two new functions, imported from Flask. The flash() function is a useful way to show a message to the user. A lot of applications use this technique to let the user know if some action has been successful or not. In this case, I'm going to use this mechanism as a temporary solution, because I don't have all the infrastructure necessary to log users in for real yet. The best I can do for now is show a message that confirms that the application received the credentials.

The second new function used in the login view function is redirect(). This function instructs the client web browser to automatically navigate to a different page, given as an argument. This view function uses it to redirect the user to the index page of the application.

When you call the flash() function, Flask stores the message, but flashed messages will not magically appear in web pages. The templates of the application need to render these flashed messages in a way that works for the site layout. I'm going to add these messages to the base template, so that all the templates inherit this functionality. This is the updated base template:

app/templates/base.html: Flashed messages in base template

<html>
    <head>
        {% if title %}
        <title>{{ title }} - microblog</title>
        {% else %}
        <title>microblog</title>
        {% endif %}
    </head>
    <body>
        <div>
            Microblog:
            <a href="/index">Home</a>
            <a href="/login">Login</a>
        </div>
        <hr>
        {% with messages = get_flashed_messages() %}
        {% if messages %}
        <ul>
            {% for message in messages %}
            <li>{{ message }}</li>
            {% endfor %}
        </ul>
        {% endif %}
        {% endwith %}
        {% block content %}{% endblock %}
    </body>
</html>

Here I'm using a with construct to assign the result of calling get_flashed_messages() to a messages variable, all in the context of the template. The get_flashed_messages() function comes from Flask, and returns a list of all the messages that have been registered with flash() previously. The conditional that follows checks if messages has some content, and in that case, a <ul> element is rendered with each message as a <li> list item. This style of rendering does not look great, but the topic of styling the web application will come later.

An interesting property of these flashed messages is that once they are requested once through the get_flashed_messages function they are removed from the message list, so they appear only once after the flash() function is called.

This is a great time to try the application one more time and test how the form works. Make sure you try submitting the form with the username or password fields empty, to see how the DataRequired validator halts the submission process.

Improving Field Validation

The validators that are attached to form fields prevent invalid data from being accepted into the application. The way the application deals with invalid form input is by re-displaying the form, to let the user make the necessary corrections.

If you tried to submit invalid data, I'm sure you noticed that while the validation mechanisms work well, there is no indication given to the user that something is wrong with the form, the user simply gets the form back. The next task is to improve the user experience by adding a meaningful error message next to each field that failed validation.

In fact, the form validators generate these descriptive error messages already, so all that is missing is some additional logic in the template to render them.

Here is the login template with added field validation messages in the username and password fields:

app/templates/login.html: Validation errors in login form template

{% extends "base.html" %}

{% block content %}
    <h1>Sign In</h1>
    <form action="" method="post" novalidate>
        {{ form.hidden_tag() }}
        <p>
            {{ form.username.label }}<br>
            {{ form.username(size=32) }}<br>
            {% for error in form.username.errors %}
            <span style="color: red;">[{{ error }}]</span>
            {% endfor %}
        </p>
        <p>
            {{ form.password.label }}<br>
            {{ form.password(size=32) }}<br>
            {% for error in form.password.errors %}
            <span style="color: red;">[{{ error }}]</span>
            {% endfor %}
        </p>
        <p>{{ form.remember_me() }} {{ form.remember_me.label }}</p>
        <p>{{ form.submit() }}</p>
    </form>
{% endblock %}

The only change I've made is to add for loops right after the username and password fields that render the error messages added by the validators in red color. As a general rule, any fields that have validators attached will have error messages added under form.<field_name>.errors. This is going to be a list, because fields can have multiple validators attached and more than one may be providing error messages to display to the user.

If you try to submit the form with an empty username or password, you will now get a nice error message in red.

Form validation

Generating Links

The login form is fairly complete now, but before closing this chapter I wanted to discuss the proper way to include links in templates and redirects. So far you have seen a few instances in which links are defined. For example, this is the current navigation bar in the base template:

    <div>
        Microblog:
        <a href="/index">Home</a>
        <a href="/login">Login</a>
    </div>

The login view function also defines a link that is passed to the redirect() function:

@app.route('/login', methods=['GET', 'POST'])
def login():
    form = LoginForm()
    if form.validate_on_submit():
        # ...
        return redirect('/index')
    # ...

One problem with writing links directly in templates and source files is that if one day you decide to reorganize your links, then you are going to have to search and replace these links in your entire application.

To have better control over these links, Flask provides a function called url_for(), which generates URLs using its internal mapping of URLs to view functions. For example, url_for('login') returns /login, and url_for('index') return '/index. The argument to url_for() is the endpoint name, which is the name of the view function.

You may ask why is it better to use the function names instead of URLs. The fact is that URLs are much more likely to change than view function names, which are completely internal. A secondary reason is that as you will learn later, some URLs have dynamic components in them, so generating those URLs by hand would require concatenating multiple elements, which is tedious and error prone. The url_for() is also able to generate these complex URLs.

So from now on, I'm going to use url_for() every time I need to generate an application URL. The navigation bar in the base template then becomes:

app/templates/base.html: Use url\_for() function for links

    <div>
        Microblog:
        <a href="{{ url_for('index') }}">Home</a>
        <a href="{{ url_for('login') }}">Login</a>
    </div>

And here is the updated login() view function:

app/routes.py: Use url\_for() function for links

from flask import render_template, flash, redirect, url_for

# ...

@app.route('/login', methods=['GET', 'POST'])
def login():
    form = LoginForm()
    if form.validate_on_submit():
        # ...
        return redirect(url_for('index'))
    # ...

175 comments

  • #1 Jjagwe Dennis said 2017-12-20T13:12:55Z

    Thanks Miguel for the wonderful work, I am a beginner in python and I would like to read this tutorial, As I have been passing through it I found this line >> SECRET_KEY = os.environ.get('SECRET_KEY') or 'you-will-never-guess' Wont it be better if its written like this >> SECRET_KEY = os.environ.get('SECRET_KEY', 'you-will-never-guess') Because the get method of dictionaries has a second argument which is the default value if a key is not found Correct me if I'm wrong. Thanks

  • #2 Miguel Grinberg said 2017-12-20T22:28:24Z

    @Jjagwe: I prefer the "or" method, as that also works if the environment variable is set to an empty string.

  • #3 Tommy said 2017-12-20T23:29:29Z

    this is awesome! cant wait until part 4 is out. really impressive work. 10/10 stars

  • #4 Jjagwe Dennis said 2017-12-21T12:48:17Z

    >> @Jjagwe: I prefer the "or" method, as that also works if the environment variable is set to an empty string. Can you please share why you prefer this? Is it because of performance, readability or a personal preference?

  • #5 Murtuza Z said 2017-12-21T17:31:16Z

    Thank you for in-depth tutorials. I have one question, which one is more pythonic syntax? SECRET_KEY = os.environ.get('SECRET_KEY') or 'you-will-never-guess' or SECRET_KEY = os.environ.get('SECRET_KEY', 'you-will-never-guess')

  • #6 Paulo said 2017-12-22T02:42:43Z

    Keep up the great work, man! Your tutorials are infinitely superior to the official ones. I'm finally understanding what's up with Flask, and I'm seeing how much more fun it is in comparison to Django.

  • #7 Nic said 2017-12-23T04:51:19Z

    Im following this lesson as well, really great, awaiting lesson 4!

  • #8 Miguel Grinberg said 2017-12-23T18:35:32Z

    @Jjagwe: I told you why, because you can have an empty environment variable set in your environment. With the default inside the get method you will get an empty string. With the or operator, the empty string will equate to False and then you'll get your default.

  • #9 Abraham Trevino said 2017-12-26T20:52:51Z

    Miguel, I love this tutorial! If you are using Python 36, any reason why you are not using f-strings instead of the .format? or is it just a matter of preference?

  • #10 Patrick Kennedy said 2017-12-27T05:54:46Z

    Hi Miguel, The updated Flask Mega-Tutorial is incredible! I've been learning so much from this tutorial. In the template file (login.html), I was expecting to see the form element explicitly define the action attribute, such as: <form action="{{ url_for('login') }}" method="post"> I think this will have the same result as using action="", as the POST will be sent to the '/login' route. Any thoughts on the best approach? Thank you, Patrick

  • #11 Miguel Grinberg said 2017-12-28T07:12:11Z

    @Abraham: only to stay compatible with 3.5 and 2.7.

  • #12 Miguel Grinberg said 2017-12-28T07:18:04Z

    @Patrick: an empty action submits the form to the URL that is on the address bar, so it is effectively the same as adding the /login URL. Both approaches are equivalent, I prefer the empty string because it is one less thing that you can make a mistake on.

  • #13 alfredzhou said 2017-12-28T12:00:25Z

    Hi, Miguel. How can i change the messages of warnings by validators pass to me? Or are there any chance i can use another language like Chinese to display those messages? Thank you your tutorials.

  • #14 Miguel Grinberg said 2017-12-28T16:50:19Z

    @alfredzhou: You can provide your own error message as a "message" argument to each validator, but note that wtforms already provides translated messages for most languages including Chinese. You will get to how to work with translations later in the tutorial.

  • #15 Brett Vanderwerff said 2017-12-29T05:59:49Z

    I don't know if you have time to address this or not, but why is object passed in "class Config(object):". I looked through the official docs and saw the same thing, but could not find an explanation. I will feel bad if this something I missed or if it is a basic python thing that I never picked up. Thanks again for making these resources open to us.

  • #16 Miguel Grinberg said 2017-12-29T17:59:33Z

    @Brett: the object base class is documented here: https://docs.python.org/3/library/functions.html#object

  • #17 Frank said 2018-01-01T23:30:00Z

    Hi Miguel, Thanks for putting this course together. It simple yet informative. Here is my question. Should FLASK_APP persist in the virtual environment? I'd did lessons 1 & 2 back to back without leaving the virtual env. When I went in run the app today I got this error: "Error: Could not locate Flask application. You did not provide the FLASK_APP environment variable." So I ran echo $FLASK_APP and it returned nothing. If the environment variables aren't persistant by default is there a way to force it? Thanks in advance.

  • #18 Miguel Grinberg said 2018-01-02T06:26:28Z

    @Frank: the current version of Flask does not provide any way to persist the FLASK_APP variable, so if you want to do it, you need to do it in a way that your operating system supports. So for example, if you are using bash, you can add the variable to your .bashrc file. Some people modify the activate script from the virtual environment to add this variable, but I don't like that practice because I tend to refresh my virtualenvs fairly often. The master branch of Flask supports writing this variable in a .flaskenv file, so when that is released the situation is going to be a little better.

  • #19 Sean said 2018-01-05T16:35:41Z

    Great tutorial on flask-wtf. How would you deal with complex forms with relationships in flask-wtf? For example, I just built an add customer form, which also allowed the user to add addresses, phone numbers, multiple sub-contact information as well as the customer details. So essentially the form consisted of string fields, number fields as well as form fields contained within it. I had to manually map all the data from the form to the corresponding sqlalchemy models, and vice versa on the update. What I am curious is if you have any suggestions to make this simpler in the long term e.g. directly map forms with relationships to sqlalchemy models with relationships. Loving the ebook bdw!

  • #20 Miguel Grinberg said 2018-01-05T20:00:30Z

    @Sean: for this type of form where you can have lists of sub-entities (phone numbers, addresses, etc.) I would probably not use the type of solution presented in this chapter. I would instead build the form in JavaScript, and then when the form is submitted send all the data in one big payload to the server. Then in the server, your POST request handler can take that data apart and create all the relationships as needed. I think when you separate things in this way you end up with a much cleaner implementation for the server. The JavaScript side is not going to be trivial, but I don't see a way to avoid that if you want to provide a good user experience to your users.

  • #21 Troy said 2018-01-07T05:34:04Z

    Hello, in the configuration paragraph, you said: "config.py module in the top-level directory". So the path will be "app/config.py" -- right?

  • #22 Daniel Martinez said 2018-01-07T16:17:00Z

    Hi Miguel, Thanks for putting this together, I am finding it very helpful. One quick question I haven't been able to answer: How do I easily view the methods and attributes available on an instance of WTForms? Is there a way to load routes.py into IPython and call dir() or vars() on an instance of LoginForm? I've read through the documentation for WTForms (https://wtforms.readthedocs.io/en/latest/fields.html) and I realize everything you've done here can be found there, but it would be nice to be able to run a quick Python command to verify it too.

  • #23 Miguel Grinberg said 2018-01-07T17:55:47Z

    @Troy: No. your top-level directory is microblog, put config.py in there, as a sibling to the "app" directory.

  • #24 Miguel Grinberg said 2018-01-07T17:58:38Z

    @Daniel: You can create a scratch instance of the form you are interested in, directly in your IPython shell. The form instances can be created outside of a route, they are just normal Python objects.

  • #25 Taner said 2018-01-09T20:01:20Z

    When I try the interpreter line: >>> from microblog import app >>> app.config['SECRET_KEY'] I get a traceback error, indicating microblog has no attribute 'config'. However, when I import from app (i.e. from microblog.app import app) it works. Any idea what I'm doing wrong?

Leave a Comment