Merge from tree-cleanup-branch: VRP, store CCP, store copy-prop, incremental SSA updating of FUD chains and newly exposed symbols. * Makefile.in (tree-ssa-copy.o): Depend on tree-ssa-propagate.h. (OBJS-common): Add tree-vrp.o. (tree-vrp.o): New rule. * basic-block.h (nearest_common_dominator_for_set): Declare. * common.opt (ftree-store-ccp): New flag. (ftree-copy-prop): New flag. (ftree-vrp): New flag. (ftree-store-copy-prop): New flag. * dominance.c (nearest_common_dominator_for_set): New. * domwalk.c (walk_dominator_tree): Only traverse statements in blocks marked in walk_data->interesting_blocks. * domwalk.h (struct dom_walk_data): Add field interesting_blocks. * fold-const.c (fold): Handle ASSERT_EXPR. * opts.c (decode_options): Set flag_tree_copy_prop at -O1. Set flag_tree_store_ccp, flag_tree_store_copy_prop and flag_tree_vrp at -O2. * timevar.def (TV_TREE_VRP): Define. (TV_TREE_COPY_PROP): Define. (TV_TREE_STORE_COPY_PROP): Define. (TV_TREE_SSA_INCREMENTAL): Define. (TV_TREE_STORE_CCP): Define. * tree-cfg.c (tree_can_merge_blocks_p): Remove reference to kill_redundant_phi_nodes from comment. (verify_expr): Handle ASSERT_EXPR. * tree-dfa.c (mark_new_vars_to_rename): Remove second argument. Update all users. (mark_call_clobbered_vars_to_rename): Remove. Update all users. * tree-flow-inline.h (unmodifiable_var_p): New. * tree-flow.h (enum value_range_type): Declare. (struct value_range_def): Declare. (value_range): Declare. (remove_all_phi_nodes_for): Remove. Update all users. (find_phi_node_for): Declare. (add_type_alias): Declare. (count_uses_and_derefs): Declare. (kill_redundant_phi_nodes): Remove. (rewrite_into_ssa): Remove. (rewrite_def_def_chains): Remove. (update_ssa, register_new_name_mapping, create_new_def_for, need_ssa_update_p, name_registered_for_update_p, release_ssa_name_after_update_ssa, dump_repl_tbl, debug_repl_tbl, dump_names_replaced_by, debug_names_replaced_by, mark_sym_for_renaming, mark_set_for_renaming, get_current_def, set_current_def, get_value_range, dump_value_range, debug_value_range, dump_all_value_ranges, debug_all_value_ranges, expr_computes_nonzero, loop_depth_of_name, unmodifiable_var_p): Declare. * tree-gimple.c (is_gimple_formal_tmp_rhs): Handle ASSERT_EXPR. * tree-into-ssa.c (block_defs_stack): Update comment. (old_ssa_names, new_ssa_names, old_virtual_ssa_names, syms_to_rename, names_to_release, repl_tbl, need_to_initialize_update_ssa_p, need_to_update_vops_p, need_to_replace_names_p): New locals. (NAME_SETS_GROWTH_FACTOR): Define. (struct repl_map_d): Declare. (struct mark_def_sites_global_data): Add field interesting_blocks. (enum rewrite_mode): Declare. (REGISTER_DEFS_IN_THIS_STMT): Define. (compute_global_livein): Use last_basic_block instead of n_basic_blocks. (set_def_block): Remove last argument. Update all callers. (prepare_use_operand_for_rename): Remove. Update all callers. (prepare_def_operand_for_rename): Remove. Update all callers. (symbol_marked_for_renaming): New. (is_old_name): New. (is_new_name): New. (repl_map_hash): New. (repl_map_eq): New. (repl_map_free): New. (names_replaced_by): New. (add_to_repl_tbl): New. (add_new_name_mapping): New. (mark_def_sites): Assume that all the operands in the statement are in normal form. (find_idf): Assert that the block in the stack is valid. (get_default_def_for): New. (insert_phi_nodes_for): Add new argument 'update_p'. Add documentation. If update_p is true, add a new mapping between the LHS of each new PHI and the name that it replaces. (insert_phi_nodes_1): Only call find_idf if needed. (get_reaching_def): Call get_default_def_for. (rewrite_operand): Remove. (rewrite_stmt): Do nothing if REGISTER_DEFS_IN_THIS_STMT and REWRITE_THIS_STMT are false. Assume that all the operands in the statement are in normal form. (rewrite_add_phi_arguments): Don't use PHI_REWRITTEN. (rewrite_virtual_phi_arguments): Remove. (invalidate_name_tags): Remove. (register_new_update_single, register_new_update_set, rewrite_update_init_block, replace_use, rewrite_update_fini_block, rewrite_update_stmt, rewrite_update_phi_arguments): New. rewrite_blocks): Remove argument 'fix_virtual_phis'. Add arguments 'entry', 'what' and 'blocks'. Initialize the dominator walker according to 'what' and 'blocks'. Start the dominator walk at 'entry'. (mark_def_site_blocks): Add argument 'interesting_blocks'. Use it to configure the dominator walker. (rewrite_into_ssa): Remove argument 'all'. Make internal. (rewrite_all_into_ssa): Remove. (rewrite_def_def_chains): Remove. (mark_def_interesting, mark_use_interesting, prepare_phi_args_for_update, prepare_block_for_update, prepare_def_site_for, prepare_def_sites, dump_names_replaced_by, debug_names_replaced_by, dump_repl_tbl, debug_repl_tbl, init_update_ssa, delete_update_ssa, create_new_def_for, register_new_name_mapping, mark_sym_for_renaming, mark_set_for_renaming, need_ssa_update_p, name_registered_for_update_p, ssa_names_to_replace, release_ssa_name_after_update_ssa, insert_updated_phi_nodes_for, update_ssa): New. * tree-loop-linear.c (linear_transform_loops): Call update_ssa instead of rewrite_into_ssa. * tree-optimize.c (vars_to_rename): Remove. Update all users. (init_tree_optimization_passes): Replace pass_redundant_phi with pass_copy_prop. Add pass_vrp. Replace pass_ccp with pass_store_ccp. Add pass_store_copy_prop after pass_store_ccp. (execute_todo): If the TODO_ flags don't include updating the SSA form, assert that it does not need to be updated. Call update_ssa instead of rewrite_into_ssa and rewrite_def_def_chains. If TODO_verify_loops is set, call verify_loop_closed_ssa. (tree_rest_of_compilation): * tree-pass.h (TODO_dump_func, TODO_ggc_collect, TODO_verify_ssa, TODO_verify_flow, TODO_verify_stmts, TODO_cleanup_cfg): Renumber. (TODO_verify_loops, TODO_update_ssa, TODO_update_ssa_no_phi, TODO_update_ssa_full_phi, TODO_update_ssa_only_virtuals): Define. (pass_copy_prop, pass_store_ccp, pass_store_copy_prop, pass_vrp): Declare. * tree-phinodes.c (make_phi_node): Update documentation. (remove_all_phi_nodes_for): Remove. (find_phi_node_for): New. * tree-pretty-print.c (dump_generic_node): Handle ASSERT_EXPR. * tree-scalar-evolution.c (follow_ssa_edge_in_rhs): Likewise. (interpret_rhs_modify_expr): Likewise. * tree-sra.c (decide_instantiations): Mark all symbols in SRA_CANDIDATES for renaming. (mark_all_v_defs_1): Rename from mark_all_v_defs. (mark_all_v_defs): New function. Update all users to call it with the whole list of scalarized statements, not just the first one. * tree-ssa-alias.c (count_ptr_derefs): Make extern. (compute_flow_insensitive_aliasing): If the tag is unmodifiable and the variable isn't or vice-versa, don't make them alias of each other. (setup_pointers_and_addressables): If the type tag for VAR is about to change, mark the old one for renaming. (add_type_alias): New. * tree-ssa-ccp.c: Document SSA-CCP and STORE-CCP. (ccp_lattice_t): Rename from latticevalue. (value): Remove. Update all users. (const_val): New local variable. (do_store_ccp): New local variable. (dump_lattice_value): Handle UNINITIALIZED. (debug_lattice_value): New. (get_default_value): Re-write. (set_lattice_value): Re-write. (def_to_varying): Remove. Update all users. (likely_value): Return VARYING for statements that make stores when STORE_CCP is false. Return VARYING for any statement other than MODIFY_EXPR, COND_EXPR and SWITCH_EXPR. (ccp_initialize): Re-write. (replace_uses_in, replace_vuse_in, substitute_and_fold): Move to tree-ssa-propagate.c. (ccp_lattice_meet): Handle memory stores when DO_STORE_CCP is true. (ccp_visit_phi_node): Likewise. (ccp_fold): Likewise. (evaluate_stmt): Likewise. (visit_assignment): Likewise. (ccp_visit_stmt): Likewise. (execute_ssa_ccp): Add argument 'store_ccp'. Copy it into DO_STORE_CCP. (do_ssa_ccp): New. (pass_ccp): Use it. (do_ssa_store_ccp): New. (gate_store_ccp): New. (pass_store_ccp): Declare. * tree-ssa-copy.c: Include tree-ssa-propagate.h. (may_propagate_copy): Reformat. Don't abort if ORIG is a virtual and DEST isn't. If NEW does not have alias information but DEST does, copy it. (copy_of, cached_last_copy_of, do_store_copy_prop, enum copy_prop_kind, which_copy_prop): Declare. (stmt_may_generate_copy, get_copy_of_val, get_last_copy_of, set_copy_of_val, dump_copy_of, copy_prop_visit_assignment, copy_prop_visit_cond_stmt, copy_prop_visit_stmt, copy_prop_visit_phi_node, init_copy_prop, fini_copy_prop, execute_copy_prop, gate_copy_prop, do_copy_prop, gate_store_copy_prop, store_copy_prop): New. (pass_copy_prop, pass_store_copy_prop): Declare. * tree-ssa-dom.c (struct opt_stats_d): Add fields 'num_const_prop' and 'num_copy_prop'. (cprop_operand): Update them. (dump_dominator_optimization_stats): Dump them. (tree_ssa_dominator_optimize): Call update_ssa instead of rewrite_into_ssa. (loop_depth_of_name): Declare extern. (simplify_cond_and_lookup_avail_expr): Guard against NULL values for LOW or HIGH. (cprop_into_successor_phis): Only propagate if NEW != ORIG. (record_equivalences_from_stmt): Call expr_computes_nonzero. (cprop_operand): Only propagate if VAL != OP. * tree-ssa-dse.c (dse_optimize_stmt): Mark symbols in removed statement for renaming. * tree-ssa-loop-im.c (move_computations): Call update_ssa. * tree-ssa-loop-ivopts.c (rewrite_address_base): Call add_type_alias if necessary. Call mark_new_vars_to_rename. (tree_ssa_iv_optimize): If new symbols need to be renamed, mark every statement updated, call update_ssa and rewrite_into_loop_closed_ssa. * tree-ssa-loop-manip.c (add_exit_phis): Do not remove DEF_BB from LIVEIN if VAR is a virtual. * tree-ssa-loop.c (tree_loop_optimizer_init): Call update_ssa. * tree-ssa-operands.c (get_expr_operands): Handle ASSERT_EXPR. (get_call_expr_operands): Reformat statement. (add_stmt_operand): Don't create V_MAY_DEFs for read-only symbols. * tree-ssa-propagate.c (ssa_prop_init): Initialize SSA_NAME_VALUE for every name. (first_vdef, stmt_makes_single_load, stmt_makes_single_store, get_value_loaded_by): New. (replace_uses_in, replace_vuses_in, replace_phi_args_in, substitute_and_fold): Move from tree-ssa-ccp.c. * tree-ssa-propagate.h (struct prop_value_d, prop_value_t, first_vdef, stmt_makes_single_load, stmt_makes_single_store, get_value_loaded_by, replace_uses_in, substitute_and_fold): Declare. * tree-ssa.c (verify_use): Fix error message. (propagate_into_addr, replace_immediate_uses, get_eq_name, check_phi_redundancy, kill_redundant_phi_nodes, pass_redundant_phi): Remove. Update all users. * tree-vect-transform.c (vect_create_data_ref_ptr): Call add_type_alias, if necessary. * tree-vectorizer.h (struct _stmt_vect_info): Update documentation for field 'memtag'. * tree-vrp.c: New file. * tree.def (ASSERT_EXPR): Define. * tree.h (ASSERT_EXPR_VAR): Define. (ASSERT_EXPR_COND): Define. (SSA_NAME_VALUE_RANGE): Define. (struct tree_ssa_name): Add field 'value_range'. (PHI_REWRITTEN): Remove. (struct tree_phi_node): Remove field 'rewritten'. * doc/invoke.texi (-fdump-tree-storeccp, -ftree-copy-prop, -ftree-store-copy-prop): Document. * doc/tree-ssa.texi: Remove broken link to McCAT's compiler. Document usage of update_ssa. testsuite/ChangeLog * g++.dg/tree-ssa/pr18178.C: New test. * gcc.c-torture/execute/20030216-1.x: Ignore at -O1. * gcc.c-torture/execute/20041019-1.c: New test. * gcc.dg/tree-ssa/20041008-1.c: New test. * gcc.dg/tree-ssa/ssa-ccp-12.c: New test. * gcc.dg/tree-ssa/20030731-2.c: Update to use -fdump-tree-store_ccp. * gcc.dg/tree-ssa/20030917-1.c: Likewise. * gcc.dg/tree-ssa/20030917-3.c: Likewise. * gcc.dg/tree-ssa/20040721-1.c: Likewise. * gcc.dg/tree-ssa/ssa-ccp-1.c: Likewise. * gcc.dg/tree-ssa/ssa-ccp-2.c: Likewise. * gcc.dg/tree-ssa/ssa-ccp-3.c: Likewise. * gcc.dg/tree-ssa/ssa-ccp-7.c: Likewise. * gcc.dg/tree-ssa/ssa-ccp-9.c: Likewise. From-SVN: r97884
593 lines
16 KiB
C
593 lines
16 KiB
C
/* Code sinking for trees
|
|
Copyright (C) 2001, 2002, 2003, 2004 Free Software Foundation, Inc.
|
|
Contributed by Daniel Berlin <dan@dberlin.org>
|
|
|
|
This file is part of GCC.
|
|
|
|
GCC is free software; you can redistribute it and/or modify
|
|
it under the terms of the GNU General Public License as published by
|
|
the Free Software Foundation; either version 2, or (at your option)
|
|
any later version.
|
|
|
|
GCC is distributed in the hope that it will be useful,
|
|
but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
GNU General Public License for more details.
|
|
|
|
You should have received a copy of the GNU General Public License
|
|
along with GCC; see the file COPYING. If not, write to
|
|
the Free Software Foundation, 59 Temple Place - Suite 330,
|
|
Boston, MA 02111-1307, USA. */
|
|
|
|
#include "config.h"
|
|
#include "system.h"
|
|
#include "coretypes.h"
|
|
#include "tm.h"
|
|
#include "errors.h"
|
|
#include "ggc.h"
|
|
#include "tree.h"
|
|
#include "basic-block.h"
|
|
#include "diagnostic.h"
|
|
#include "tree-inline.h"
|
|
#include "tree-flow.h"
|
|
#include "tree-gimple.h"
|
|
#include "tree-dump.h"
|
|
#include "timevar.h"
|
|
#include "fibheap.h"
|
|
#include "hashtab.h"
|
|
#include "tree-iterator.h"
|
|
#include "real.h"
|
|
#include "alloc-pool.h"
|
|
#include "tree-pass.h"
|
|
#include "flags.h"
|
|
#include "bitmap.h"
|
|
#include "langhooks.h"
|
|
#include "cfgloop.h"
|
|
|
|
/* TODO:
|
|
1. Sinking store only using scalar promotion (IE without moving the RHS):
|
|
|
|
*q = p;
|
|
p = p + 1;
|
|
if (something)
|
|
*q = <not p>;
|
|
else
|
|
y = *q;
|
|
|
|
|
|
should become
|
|
sinktemp = p;
|
|
p = p + 1;
|
|
if (something)
|
|
*q = <not p>;
|
|
else
|
|
{
|
|
*q = sinktemp;
|
|
y = *q
|
|
}
|
|
Store copy propagation will take care of the store elimination above.
|
|
|
|
|
|
2. Sinking using Partial Dead Code Elimination. */
|
|
|
|
|
|
static struct
|
|
{
|
|
/* The number of statements sunk down the flowgraph by code sinking. */
|
|
int sunk;
|
|
|
|
} sink_stats;
|
|
|
|
|
|
/* Given a PHI, and one of its arguments (DEF), find the edge for
|
|
that argument and return it. If the argument occurs twice in the PHI node,
|
|
we return NULL. */
|
|
|
|
static basic_block
|
|
find_bb_for_arg (tree phi, tree def)
|
|
{
|
|
int i;
|
|
bool foundone = false;
|
|
basic_block result = NULL;
|
|
for (i = 0; i < PHI_NUM_ARGS (phi); i++)
|
|
if (PHI_ARG_DEF (phi, i) == def)
|
|
{
|
|
if (foundone)
|
|
return NULL;
|
|
foundone = true;
|
|
result = PHI_ARG_EDGE (phi, i)->src;
|
|
}
|
|
return result;
|
|
}
|
|
|
|
/* When the first immediate use is in a statement, then return true if all
|
|
immediate uses in IMM are in the same statement.
|
|
We could also do the case where the first immediate use is in a phi node,
|
|
and all the other uses are in phis in the same basic block, but this
|
|
requires some expensive checking later (you have to make sure no def/vdef
|
|
in the statement occurs for multiple edges in the various phi nodes it's
|
|
used in, so that you only have one place you can sink it to. */
|
|
|
|
static bool
|
|
all_immediate_uses_same_place (tree stmt)
|
|
{
|
|
tree firstuse = NULL_TREE;
|
|
ssa_op_iter op_iter;
|
|
imm_use_iterator imm_iter;
|
|
use_operand_p use_p;
|
|
tree var;
|
|
|
|
FOR_EACH_SSA_TREE_OPERAND (var, stmt, op_iter, SSA_OP_ALL_DEFS)
|
|
{
|
|
FOR_EACH_IMM_USE_FAST (use_p, imm_iter, var)
|
|
{
|
|
if (firstuse == NULL_TREE)
|
|
firstuse = USE_STMT (use_p);
|
|
else
|
|
if (firstuse != USE_STMT (use_p))
|
|
return false;
|
|
}
|
|
}
|
|
|
|
return true;
|
|
}
|
|
|
|
/* Some global stores don't necessarily have V_MAY_DEF's of global variables,
|
|
but we still must avoid moving them around. */
|
|
|
|
bool
|
|
is_hidden_global_store (tree stmt)
|
|
{
|
|
stmt_ann_t ann = stmt_ann (stmt);
|
|
v_may_def_optype v_may_defs;
|
|
v_must_def_optype v_must_defs;
|
|
|
|
/* Check virtual definitions. If we get here, the only virtual
|
|
definitions we should see are those generated by assignment
|
|
statements. */
|
|
v_may_defs = V_MAY_DEF_OPS (ann);
|
|
v_must_defs = V_MUST_DEF_OPS (ann);
|
|
if (NUM_V_MAY_DEFS (v_may_defs) > 0 || NUM_V_MUST_DEFS (v_must_defs) > 0)
|
|
{
|
|
tree lhs;
|
|
|
|
gcc_assert (TREE_CODE (stmt) == MODIFY_EXPR);
|
|
|
|
/* Note that we must not check the individual virtual operands
|
|
here. In particular, if this is an aliased store, we could
|
|
end up with something like the following (SSA notation
|
|
redacted for brevity):
|
|
|
|
foo (int *p, int i)
|
|
{
|
|
int x;
|
|
p_1 = (i_2 > 3) ? &x : p;
|
|
|
|
# x_4 = V_MAY_DEF <x_3>
|
|
*p_1 = 5;
|
|
|
|
return 2;
|
|
}
|
|
|
|
Notice that the store to '*p_1' should be preserved, if we
|
|
were to check the virtual definitions in that store, we would
|
|
not mark it needed. This is because 'x' is not a global
|
|
variable.
|
|
|
|
Therefore, we check the base address of the LHS. If the
|
|
address is a pointer, we check if its name tag or type tag is
|
|
a global variable. Otherwise, we check if the base variable
|
|
is a global. */
|
|
lhs = TREE_OPERAND (stmt, 0);
|
|
if (REFERENCE_CLASS_P (lhs))
|
|
lhs = get_base_address (lhs);
|
|
|
|
if (lhs == NULL_TREE)
|
|
{
|
|
/* If LHS is NULL, it means that we couldn't get the base
|
|
address of the reference. In which case, we should not
|
|
move this store. */
|
|
return true;
|
|
}
|
|
else if (DECL_P (lhs))
|
|
{
|
|
/* If the store is to a global symbol, we need to keep it. */
|
|
if (is_global_var (lhs))
|
|
return true;
|
|
|
|
}
|
|
else if (INDIRECT_REF_P (lhs))
|
|
{
|
|
tree ptr = TREE_OPERAND (lhs, 0);
|
|
struct ptr_info_def *pi = SSA_NAME_PTR_INFO (ptr);
|
|
tree nmt = (pi) ? pi->name_mem_tag : NULL_TREE;
|
|
tree tmt = var_ann (SSA_NAME_VAR (ptr))->type_mem_tag;
|
|
|
|
/* If either the name tag or the type tag for PTR is a
|
|
global variable, then the store is necessary. */
|
|
if ((nmt && is_global_var (nmt))
|
|
|| (tmt && is_global_var (tmt)))
|
|
{
|
|
return true;
|
|
}
|
|
}
|
|
else
|
|
gcc_unreachable ();
|
|
}
|
|
return false;
|
|
}
|
|
|
|
/* Find the nearest common dominator of all of the immediate uses in IMM. */
|
|
|
|
static basic_block
|
|
nearest_common_dominator_of_uses (tree stmt)
|
|
{
|
|
bitmap blocks = BITMAP_ALLOC (NULL);
|
|
basic_block commondom;
|
|
unsigned int j;
|
|
bitmap_iterator bi;
|
|
ssa_op_iter op_iter;
|
|
imm_use_iterator imm_iter;
|
|
use_operand_p use_p;
|
|
tree var;
|
|
|
|
bitmap_clear (blocks);
|
|
FOR_EACH_SSA_TREE_OPERAND (var, stmt, op_iter, SSA_OP_ALL_DEFS)
|
|
{
|
|
FOR_EACH_IMM_USE_FAST (use_p, imm_iter, var)
|
|
{
|
|
tree usestmt = USE_STMT (use_p);
|
|
basic_block useblock;
|
|
if (TREE_CODE (usestmt) == PHI_NODE)
|
|
{
|
|
int idx = PHI_ARG_INDEX_FROM_USE (use_p);
|
|
|
|
useblock = PHI_ARG_EDGE (usestmt, idx)->src;
|
|
/* Short circuit. Nothing dominates the entry block. */
|
|
if (useblock == ENTRY_BLOCK_PTR)
|
|
{
|
|
BITMAP_FREE (blocks);
|
|
return NULL;
|
|
}
|
|
bitmap_set_bit (blocks, useblock->index);
|
|
}
|
|
else
|
|
{
|
|
useblock = bb_for_stmt (usestmt);
|
|
|
|
/* Short circuit. Nothing dominates the entry block. */
|
|
if (useblock == ENTRY_BLOCK_PTR)
|
|
{
|
|
BITMAP_FREE (blocks);
|
|
return NULL;
|
|
}
|
|
bitmap_set_bit (blocks, useblock->index);
|
|
}
|
|
}
|
|
}
|
|
commondom = BASIC_BLOCK (bitmap_first_set_bit (blocks));
|
|
EXECUTE_IF_SET_IN_BITMAP (blocks, 0, j, bi)
|
|
commondom = nearest_common_dominator (CDI_DOMINATORS, commondom,
|
|
BASIC_BLOCK (j));
|
|
BITMAP_FREE (blocks);
|
|
return commondom;
|
|
}
|
|
|
|
/* Given a statement (STMT) and the basic block it is currently in (FROMBB),
|
|
determine the location to sink the statement to, if any.
|
|
Return the basic block to sink it to, or NULL if we should not sink
|
|
it. */
|
|
|
|
static tree
|
|
statement_sink_location (tree stmt, basic_block frombb)
|
|
{
|
|
tree use, def;
|
|
use_operand_p one_use = NULL_USE_OPERAND_P;
|
|
basic_block sinkbb;
|
|
use_operand_p use_p;
|
|
def_operand_p def_p;
|
|
ssa_op_iter iter;
|
|
stmt_ann_t ann;
|
|
tree rhs;
|
|
imm_use_iterator imm_iter;
|
|
|
|
FOR_EACH_SSA_TREE_OPERAND (def, stmt, iter, SSA_OP_ALL_DEFS)
|
|
{
|
|
FOR_EACH_IMM_USE_FAST (one_use, imm_iter, def)
|
|
{
|
|
break;
|
|
}
|
|
if (one_use != NULL_USE_OPERAND_P)
|
|
break;
|
|
}
|
|
|
|
/* Return if there are no immediate uses of this stmt. */
|
|
if (one_use == NULL_USE_OPERAND_P)
|
|
return NULL;
|
|
|
|
if (TREE_CODE (stmt) != MODIFY_EXPR)
|
|
return NULL;
|
|
rhs = TREE_OPERAND (stmt, 1);
|
|
|
|
/* There are a few classes of things we can't or don't move, some because we
|
|
don't have code to handle it, some because it's not profitable and some
|
|
because it's not legal.
|
|
|
|
We can't sink things that may be global stores, at least not without
|
|
calculating a lot more information, because we may cause it to no longer
|
|
be seen by an external routine that needs it depending on where it gets
|
|
moved to.
|
|
|
|
We don't want to sink loads from memory.
|
|
|
|
We can't sink statements that end basic blocks without splitting the
|
|
incoming edge for the sink location to place it there.
|
|
|
|
We can't sink statements that have volatile operands.
|
|
|
|
We don't want to sink dead code, so anything with 0 immediate uses is not
|
|
sunk.
|
|
|
|
*/
|
|
ann = stmt_ann (stmt);
|
|
if (NUM_VUSES (STMT_VUSE_OPS (stmt)) != 0
|
|
|| stmt_ends_bb_p (stmt)
|
|
|| TREE_SIDE_EFFECTS (rhs)
|
|
|| TREE_CODE (rhs) == EXC_PTR_EXPR
|
|
|| TREE_CODE (rhs) == FILTER_EXPR
|
|
|| is_hidden_global_store (stmt)
|
|
|| ann->has_volatile_ops)
|
|
return NULL;
|
|
|
|
FOR_EACH_SSA_DEF_OPERAND (def_p, stmt, iter, SSA_OP_ALL_DEFS)
|
|
{
|
|
tree def = DEF_FROM_PTR (def_p);
|
|
if (is_global_var (SSA_NAME_VAR (def))
|
|
|| SSA_NAME_OCCURS_IN_ABNORMAL_PHI (def))
|
|
return NULL;
|
|
}
|
|
|
|
FOR_EACH_SSA_USE_OPERAND (use_p, stmt, iter, SSA_OP_ALL_USES)
|
|
{
|
|
tree use = USE_FROM_PTR (use_p);
|
|
if (SSA_NAME_OCCURS_IN_ABNORMAL_PHI (use))
|
|
return NULL;
|
|
}
|
|
|
|
/* If all the immediate uses are not in the same place, find the nearest
|
|
common dominator of all the immediate uses. For PHI nodes, we have to
|
|
find the nearest common dominator of all of the predecessor blocks, since
|
|
that is where insertion would have to take place. */
|
|
if (!all_immediate_uses_same_place (stmt))
|
|
{
|
|
basic_block commondom = nearest_common_dominator_of_uses (stmt);
|
|
|
|
if (commondom == frombb)
|
|
return NULL;
|
|
|
|
/* Our common dominator has to be dominated by frombb in order to be a
|
|
trivially safe place to put this statement, since it has multiple
|
|
uses. */
|
|
if (!dominated_by_p (CDI_DOMINATORS, commondom, frombb))
|
|
return NULL;
|
|
|
|
/* It doesn't make sense to move to a dominator that post-dominates
|
|
frombb, because it means we've just moved it into a path that always
|
|
executes if frombb executes, instead of reducing the number of
|
|
executions . */
|
|
if (dominated_by_p (CDI_POST_DOMINATORS, frombb, commondom))
|
|
{
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
fprintf (dump_file, "Not moving store, common dominator post-dominates from block.\n");
|
|
return NULL;
|
|
}
|
|
|
|
if (commondom == frombb || commondom->loop_depth > frombb->loop_depth)
|
|
return NULL;
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
{
|
|
fprintf (dump_file, "Common dominator of all uses is %d\n",
|
|
commondom->index);
|
|
}
|
|
return first_stmt (commondom);
|
|
}
|
|
|
|
use = USE_STMT (one_use);
|
|
if (TREE_CODE (use) != PHI_NODE)
|
|
{
|
|
sinkbb = bb_for_stmt (use);
|
|
if (sinkbb == frombb || sinkbb->loop_depth > frombb->loop_depth
|
|
|| sinkbb->loop_father != frombb->loop_father)
|
|
return NULL;
|
|
return use;
|
|
}
|
|
|
|
/* Note that at this point, all uses must be in the same statement, so it
|
|
doesn't matter which def op we choose. */
|
|
if (STMT_DEF_OPS (stmt) == NULL)
|
|
{
|
|
if (STMT_V_MAY_DEF_OPS (stmt) != NULL)
|
|
def = V_MAY_DEF_RESULT (STMT_V_MAY_DEF_OPS (stmt), 0);
|
|
else if (STMT_V_MUST_DEF_OPS (stmt) != NULL)
|
|
def = V_MUST_DEF_RESULT (STMT_V_MUST_DEF_OPS (stmt), 0);
|
|
else
|
|
gcc_unreachable ();
|
|
}
|
|
else
|
|
def = DEF_OP (STMT_DEF_OPS (stmt), 0);
|
|
|
|
sinkbb = find_bb_for_arg (use, def);
|
|
if (!sinkbb)
|
|
return NULL;
|
|
|
|
/* This will happen when you have
|
|
a_3 = PHI <a_13, a_26>
|
|
|
|
a_26 = V_MAY_DEF <a_3>
|
|
|
|
If the use is a phi, and is in the same bb as the def,
|
|
we can't sink it. */
|
|
|
|
if (bb_for_stmt (use) == frombb)
|
|
return NULL;
|
|
if (sinkbb == frombb || sinkbb->loop_depth > frombb->loop_depth
|
|
|| sinkbb->loop_father != frombb->loop_father)
|
|
return NULL;
|
|
|
|
return first_stmt (sinkbb);
|
|
}
|
|
|
|
/* Perform code sinking on BB */
|
|
|
|
static void
|
|
sink_code_in_bb (basic_block bb)
|
|
{
|
|
basic_block son;
|
|
block_stmt_iterator bsi;
|
|
edge_iterator ei;
|
|
edge e;
|
|
|
|
/* If this block doesn't dominate anything, there can't be any place to sink
|
|
the statements to. */
|
|
if (first_dom_son (CDI_DOMINATORS, bb) == NULL)
|
|
goto earlyout;
|
|
|
|
/* We can't move things across abnormal edges, so don't try. */
|
|
FOR_EACH_EDGE (e, ei, bb->succs)
|
|
if (e->flags & EDGE_ABNORMAL)
|
|
goto earlyout;
|
|
|
|
for (bsi = bsi_last (bb); !bsi_end_p (bsi);)
|
|
{
|
|
tree stmt = bsi_stmt (bsi);
|
|
block_stmt_iterator tobsi;
|
|
tree sinkstmt;
|
|
get_stmt_operands (stmt);
|
|
|
|
sinkstmt = statement_sink_location (stmt, bb);
|
|
if (!sinkstmt)
|
|
{
|
|
if (!bsi_end_p (bsi))
|
|
bsi_prev (&bsi);
|
|
continue;
|
|
}
|
|
if (dump_file)
|
|
{
|
|
fprintf (dump_file, "Sinking ");
|
|
print_generic_expr (dump_file, stmt, TDF_VOPS);
|
|
fprintf (dump_file, " from bb %d to bb %d\n",
|
|
bb->index, bb_for_stmt (sinkstmt)->index);
|
|
}
|
|
tobsi = bsi_for_stmt (sinkstmt);
|
|
/* Find the first non-label. */
|
|
while (!bsi_end_p (tobsi)
|
|
&& TREE_CODE (bsi_stmt (tobsi)) == LABEL_EXPR)
|
|
bsi_next (&tobsi);
|
|
|
|
/* If this is the end of the basic block, we need to insert at the end
|
|
of the basic block. */
|
|
if (bsi_end_p (tobsi))
|
|
bsi_move_to_bb_end (&bsi, bb_for_stmt (sinkstmt));
|
|
else
|
|
bsi_move_before (&bsi, &tobsi);
|
|
|
|
sink_stats.sunk++;
|
|
if (!bsi_end_p (bsi))
|
|
bsi_prev (&bsi);
|
|
|
|
}
|
|
earlyout:
|
|
for (son = first_dom_son (CDI_POST_DOMINATORS, bb);
|
|
son;
|
|
son = next_dom_son (CDI_POST_DOMINATORS, son))
|
|
{
|
|
sink_code_in_bb (son);
|
|
}
|
|
}
|
|
|
|
/* Perform code sinking.
|
|
This moves code down the flowgraph when we know it would be
|
|
profitable to do so, or it wouldn't increase the number of
|
|
executions of the statement.
|
|
|
|
IE given
|
|
|
|
a_1 = b + c;
|
|
if (<something>)
|
|
{
|
|
}
|
|
else
|
|
{
|
|
foo (&b, &c);
|
|
a_5 = b + c;
|
|
}
|
|
a_6 = PHI (a_5, a_1);
|
|
USE a_6.
|
|
|
|
we'll transform this into:
|
|
|
|
if (<something>)
|
|
{
|
|
a_1 = b + c;
|
|
}
|
|
else
|
|
{
|
|
foo (&b, &c);
|
|
a_5 = b + c;
|
|
}
|
|
a_6 = PHI (a_5, a_1);
|
|
USE a_6.
|
|
|
|
Note that this reduces the number of computations of a = b + c to 1
|
|
when we take the else edge, instead of 2.
|
|
*/
|
|
static void
|
|
execute_sink_code (void)
|
|
{
|
|
struct loops *loops = loop_optimizer_init (dump_file);
|
|
connect_infinite_loops_to_exit ();
|
|
memset (&sink_stats, 0, sizeof (sink_stats));
|
|
calculate_dominance_info (CDI_DOMINATORS | CDI_POST_DOMINATORS);
|
|
sink_code_in_bb (EXIT_BLOCK_PTR);
|
|
if (dump_file && (dump_flags & TDF_STATS))
|
|
fprintf (dump_file, "Sunk statements:%d\n", sink_stats.sunk);
|
|
free_dominance_info (CDI_POST_DOMINATORS);
|
|
remove_fake_exit_edges ();
|
|
loop_optimizer_finalize (loops, dump_file);
|
|
}
|
|
|
|
/* Gate and execute functions for PRE. */
|
|
|
|
static void
|
|
do_sink (void)
|
|
{
|
|
execute_sink_code ();
|
|
}
|
|
|
|
static bool
|
|
gate_sink (void)
|
|
{
|
|
return flag_tree_sink != 0;
|
|
}
|
|
|
|
struct tree_opt_pass pass_sink_code =
|
|
{
|
|
"sink", /* name */
|
|
gate_sink, /* gate */
|
|
do_sink, /* execute */
|
|
NULL, /* sub */
|
|
NULL, /* next */
|
|
0, /* static_pass_number */
|
|
TV_TREE_SINK, /* tv_id */
|
|
PROP_no_crit_edges | PROP_cfg
|
|
| PROP_ssa | PROP_alias, /* properties_required */
|
|
0, /* properties_provided */
|
|
0, /* properties_destroyed */
|
|
0, /* todo_flags_start */
|
|
TODO_update_ssa
|
|
| TODO_dump_func
|
|
| TODO_ggc_collect
|
|
| TODO_verify_ssa, /* todo_flags_finish */
|
|
0 /* letter */
|
|
};
|